-- Logs begin at Wed 2022-07-27 11:39:40 UTC, end at Wed 2022-07-27 12:53:18 UTC. -- Jul 27 12:26:09.467666 dv-osbrick-836063-13-ceph systemd[1]: Starting Devstack devstack@keystone.service... Jul 27 12:26:09.476975 dv-osbrick-836063-13-ceph devstack@keystone.service[87905]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 27 12:26:09.478633 dv-osbrick-836063-13-ceph devstack@keystone.service[87905]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 27 12:26:09 2022] *** Jul 27 12:26:09.478633 dv-osbrick-836063-13-ceph devstack@keystone.service[87905]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 27 12:26:09.478633 dv-osbrick-836063-13-ceph devstack@keystone.service[87905]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 27 12:26:09.478633 dv-osbrick-836063-13-ceph devstack@keystone.service[87905]: nodename: dv-osbrick-836063-13-ceph Jul 27 12:26:09.478633 dv-osbrick-836063-13-ceph devstack@keystone.service[87905]: machine: x86_64 Jul 27 12:26:09.478633 dv-osbrick-836063-13-ceph devstack@keystone.service[87905]: clock source: unix Jul 27 12:26:09.478633 dv-osbrick-836063-13-ceph devstack@keystone.service[87905]: pcre jit disabled Jul 27 12:26:09.478633 dv-osbrick-836063-13-ceph devstack@keystone.service[87905]: detected number of CPU cores: 4 Jul 27 12:26:09.478633 dv-osbrick-836063-13-ceph devstack@keystone.service[87905]: current working directory: / Jul 27 12:26:09.478633 dv-osbrick-836063-13-ceph devstack@keystone.service[87905]: detected binary path: /usr/bin/uwsgi-core Jul 27 12:26:09.478633 dv-osbrick-836063-13-ceph devstack@keystone.service[87905]: your processes number limit is 47680 Jul 27 12:26:09.479198 dv-osbrick-836063-13-ceph devstack@keystone.service[87905]: your memory page size is 4096 bytes Jul 27 12:26:09.479198 dv-osbrick-836063-13-ceph devstack@keystone.service[87905]: detected max file descriptor number: 2048 Jul 27 12:26:09.479198 dv-osbrick-836063-13-ceph devstack@keystone.service[87905]: lock engine: pthread robust mutexes Jul 27 12:26:09.479198 dv-osbrick-836063-13-ceph devstack@keystone.service[87905]: thunder lock: enabled Jul 27 12:26:09.479198 dv-osbrick-836063-13-ceph devstack@keystone.service[87905]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 27 12:26:09.479198 dv-osbrick-836063-13-ceph devstack@keystone.service[87905]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 27 12:26:09.523216 dv-osbrick-836063-13-ceph devstack@keystone.service[87905]: Python main interpreter initialized at 0x564885dba9c0 Jul 27 12:26:09.523216 dv-osbrick-836063-13-ceph devstack@keystone.service[87905]: python threads support enabled Jul 27 12:26:09.523216 dv-osbrick-836063-13-ceph devstack@keystone.service[87905]: your server socket listen backlog is limited to 100 connections Jul 27 12:26:09.523216 dv-osbrick-836063-13-ceph devstack@keystone.service[87905]: your mercy for graceful operations on workers is 90 seconds Jul 27 12:26:09.523578 dv-osbrick-836063-13-ceph devstack@keystone.service[87905]: mapped 403077 bytes (393 KB) for 2 cores Jul 27 12:26:09.523662 dv-osbrick-836063-13-ceph devstack@keystone.service[87905]: *** Operational MODE: preforking *** Jul 27 12:26:09.523893 dv-osbrick-836063-13-ceph devstack@keystone.service[87905]: *** uWSGI is running in multiple interpreter mode *** Jul 27 12:26:09.523893 dv-osbrick-836063-13-ceph devstack@keystone.service[87905]: spawned uWSGI master process (pid: 87905) Jul 27 12:26:09.524098 dv-osbrick-836063-13-ceph systemd[1]: Started Devstack devstack@keystone.service. Jul 27 12:26:09.525194 dv-osbrick-836063-13-ceph devstack@keystone.service[87905]: spawned uWSGI worker 1 (pid: 87917, cores: 1) Jul 27 12:26:09.525194 dv-osbrick-836063-13-ceph devstack@keystone.service[87905]: spawned uWSGI worker 2 (pid: 87918, cores: 1) Jul 27 12:26:09.525194 dv-osbrick-836063-13-ceph devstack@keystone.service[87905]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 27 12:26:15.233211 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 12:26:15.233211 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: from cryptography.utils import int_from_bytes Jul 27 12:26:15.234103 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 12:26:15.234103 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: from cryptography.utils import int_from_bytes Jul 27 12:26:15.234514 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 12:26:15.234514 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: from cryptography.utils import int_from_bytes Jul 27 12:26:15.234616 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 12:26:15.234616 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: from cryptography.utils import int_from_bytes Jul 27 12:26:15.284248 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 12:26:15.284408 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 12:26:15.284474 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 12:26:15.284563 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 12:26:15.284626 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] command line args: [] {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 12:26:15.284695 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] command line args: [] {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 12:26:15.284928 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 12:26:15.285019 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 12:26:15.285087 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ================================================================================ {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 12:26:15.285153 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ================================================================================ {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 12:26:15.285311 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] admin_token = **** {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.285400 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] admin_token = **** {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.285537 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] config_dir = [] {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.285658 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] config_dir = [] {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.285725 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.285790 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.285963 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] config_source = [] {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.286052 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] config_source = [] {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.286113 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] debug = True {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.286178 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] debug = True {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.286237 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.288649 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.288752 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.288817 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.288882 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.288942 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.289008 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.289074 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.289138 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.289202 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.289261 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] list_limit = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.289324 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] list_limit = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.289390 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] log_config_append = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.289390 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.289500 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] log_config_append = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.289500 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.289945 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] log_dir = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.289945 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] log_file = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.290380 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] log_dir = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.290583 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.290786 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] log_file = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.290961 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.291188 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.291359 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.291595 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.291761 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.291960 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.292153 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.292355 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.292605 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.292777 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.293010 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.293186 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.293382 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.293578 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.293822 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.294021 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.294190 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.294390 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.294587 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.294782 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.294973 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.295137 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.295270 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.295435 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.295587 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.295754 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.295895 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.296028 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.296028 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.296280 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.55/identity {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.296280 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] publish_errors = False {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.296280 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.296699 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.55/identity {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.296699 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] publish_errors = False {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.296973 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.296973 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.297225 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.297361 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.297491 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.297491 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.297827 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.297975 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.298107 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] standard_threads = False {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.298244 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.298425 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.298564 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] standard_threads = False {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.298697 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.298697 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.300093 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.300243 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] use_journal = False {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.300423 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.300561 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] use_json = False {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.300692 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.300824 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] use_stderr = False {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.300960 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] use_journal = False {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.301091 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] use_syslog = False {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.301233 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] use_json = False {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.301365 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.301494 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] use_stderr = False {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.301494 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] use_syslog = False {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.301834 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.301966 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 12:26:15.302108 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.302240 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.302370 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.302500 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.302630 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.302759 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.302902 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.302902 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.303156 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.303373 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.303510 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.303645 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.303794 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.303927 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.304063 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.304199 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.304382 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.304523 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.304662 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.304799 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.304930 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.305067 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.305208 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.305338 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.305479 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.305691 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.305845 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.305984 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.306123 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.306254 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.306463 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.306603 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.306734 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.306863 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.306992 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.307123 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.307260 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.307391 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.307538 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.307669 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.307798 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.307927 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.308065 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.308203 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.308347 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.308484 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.308615 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.308752 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.308890 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.309020 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.309149 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.309279 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.309419 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.309557 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.309769 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.309902 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.310031 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.310326 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.310581 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.310740 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.310875 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.311005 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.311135 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.311265 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.311401 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.311550 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.311688 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.311820 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.312024 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.312163 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.312293 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.312432 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.312563 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.312693 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.312822 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.312950 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.313079 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.313283 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.313283 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.313543 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.313704 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.313845 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.313977 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.314115 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.314246 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.314375 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.314375 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.314634 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.314765 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.314902 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.314902 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.315148 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.315302 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.316015 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.316156 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.316295 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.316427 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.316558 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.316694 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.316825 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.316960 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.317100 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.317232 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.317361 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.317490 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.317650 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.317834 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.317979 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.318111 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.318248 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.318379 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.318509 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.318640 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.318779 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.318912 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.319042 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.319172 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.319301 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.319439 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.319583 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.319723 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.319864 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.320004 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.320138 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.320268 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.320405 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.320547 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.320685 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.320864 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.321008 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.321142 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.321272 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.321414 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.321557 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.321754 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.321887 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.322018 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.322149 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.322290 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.322423 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.322554 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.322685 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.322816 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.322946 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.323084 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.323217 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.323363 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.323494 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.323624 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.323754 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.323893 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.324025 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.324156 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.324293 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.324425 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.324555 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.324693 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.324826 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.324957 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.325087 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.325227 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.325363 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.325502 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.325651 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.325788 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.325929 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.325929 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.326192 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.326332 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.326470 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.326470 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.326726 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.326857 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.326998 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.327209 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.327350 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.327482 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.327613 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.327744 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.327879 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.328018 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.328165 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.328315 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.328448 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.328578 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.328708 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.328838 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.328980 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.329120 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.329254 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.329384 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.329520 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.329689 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.329835 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.329969 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.330099 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.330274 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.330406 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.330536 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.330674 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.330806 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.330946 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.331692 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.331837 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.331969 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] auth.external = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.332109 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.332243 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.332374 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.332513 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.332648 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.332779 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.332918 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] auth.external = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.333077 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] auth.password = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.333225 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.333369 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] auth.token = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.333369 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.333640 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.333781 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.333913 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.334060 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.334194 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] auth.password = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.334332 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.334464 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] auth.token = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.334609 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.334744 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.334884 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.335018 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.335221 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.335385 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.335520 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] credential.caching = True {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.335652 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.335792 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.335931 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.336068 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.336201 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.336332 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.336464 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.336604 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.336737 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] credential.caching = True {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.336869 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.337000 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.337141 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.337285 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.337426 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.337561 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.337718 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.337857 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.337989 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.338120 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.338266 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.338401 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.338533 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.338665 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.338796 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.338927 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.339078 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.339212 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.339344 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.339475 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.339607 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.339738 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.339879 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] federation.caching = True {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.340012 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.340144 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.340275 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.340406 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.340536 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.340677 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.340810 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.340955 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.341088 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] federation.caching = True {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.341219 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.341351 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.341491 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.341692 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.341832 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.341965 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.342097 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.342246 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.342497 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.342651 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.342788 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.342930 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.343061 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.343200 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.343335 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] identity.caching = True {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.343467 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.343597 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.343728 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.343860 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.344065 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.344199 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.344338 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.344470 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.344601 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] identity.caching = True {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.344742 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.344884 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.345017 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.345149 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.345279 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.345410 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.345541 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.345705 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.345840 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.345982 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.346123 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.346255 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.346386 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.346525 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.346696 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.346696 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.346951 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.347083 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.347213 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.347352 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.347485 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.347485 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.347734 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.347865 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.347996 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.348136 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.348268 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.348410 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.349564 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.349736 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.349873 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.349873 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.350148 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.350283 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.350415 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.350546 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.350677 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.350818 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.350952 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.351084 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.351217 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.351360 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.351492 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.351632 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.351765 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.351896 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.352028 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.352167 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.352300 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.352440 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.352573 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.352705 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.352835 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.352966 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.353106 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.353258 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.353392 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.353524 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.353721 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.353856 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.353988 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.354131 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.354265 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.354397 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.354528 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.354658 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.354789 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.354928 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.355077 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.355209 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.355342 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.355473 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.355604 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.355744 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.355877 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.356019 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.356152 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.356283 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.356414 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.356554 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.356694 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.356827 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.356972 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.357103 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.357234 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.357373 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.357508 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.357656 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.357793 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.357926 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.358070 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.358204 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.user = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.358335 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.358468 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.358600 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.358731 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.358881 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.359014 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.359146 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.359277 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.359407 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.359539 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.359678 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.user = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.359810 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.359941 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.360072 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.360203 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.360334 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.360473 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.360616 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.360748 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.360879 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.361011 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.361141 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.361141 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.361398 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.361398 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.361697 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.361833 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.361964 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.362173 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.362342 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.362476 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.362617 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.362750 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.362887 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.363029 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.363162 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.363293 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.363424 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.363424 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.363672 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.363812 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.363945 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.364077 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.364209 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.364346 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.364489 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.364629 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.365013 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.365152 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.365283 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.365415 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.365547 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.365720 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.365856 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.366004 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.366138 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.366138 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.366386 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.366536 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.366670 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.366670 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.366919 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.367050 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.367181 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.367320 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.367453 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.367585 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.367716 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.367847 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.367979 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.368119 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.368252 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.368393 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] resource.caching = True {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.368524 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.368656 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.368787 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.368926 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.369061 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.369192 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.369324 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.369454 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.369606 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.369606 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.369879 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.369879 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.370129 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] resource.caching = True {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.370271 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.370402 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.370542 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.370675 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.370809 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.370941 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.371073 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] role.caching = True {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.371204 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.371409 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] role.driver = sql {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.371409 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.371661 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.371661 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.371910 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.372053 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.372194 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.372329 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.372460 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.372592 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.372722 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.372861 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] role.caching = True {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.372994 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.373127 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] role.driver = sql {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.373258 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.373388 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.373519 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.373737 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.373874 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.374016 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.374149 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.374281 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.374413 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.374552 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.374686 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.374686 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.375087 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.375226 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.375360 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.375360 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.375624 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.375756 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.375899 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.376042 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.376181 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.376325 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.376460 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.376592 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.376723 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.376855 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.376987 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.377127 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.377261 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.377261 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.377511 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.377511 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.377814 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.378494 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.378637 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.378776 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.378913 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.378913 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.379175 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.379322 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.379464 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.379602 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.379739 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.379884 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.380045 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.380187 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.380325 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.380464 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.380601 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.380740 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.380886 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.381026 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.381163 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.381301 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] token.caching = True {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.381473 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.381636 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.381792 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.381934 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.382082 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.382220 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.382358 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.382495 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.382642 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.382783 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.382920 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.383059 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.383195 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.383332 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.383478 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] token.caching = True {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.383620 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.383812 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.383950 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.384098 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.384236 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.384381 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.384522 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.384661 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.384799 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.384939 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.385077 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.385223 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.385363 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.385501 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.385698 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.385845 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.385994 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.386144 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.386284 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.386429 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.386572 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] database.connection = **** {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.386720 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.387008 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.387169 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.387319 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.387461 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.387599 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.387736 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.387875 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.388013 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.388170 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.388311 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.388449 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.388587 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.388725 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.388863 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] database.connection = **** {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.389013 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.389162 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.389310 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.389450 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.389588 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.389753 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.389891 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.390030 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.390188 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.390329 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.390467 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.390604 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.390742 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.390879 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.391027 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.391167 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.391305 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.391442 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.391580 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.391717 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.391863 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.391863 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87917) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 12:26:15.392147 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.392147 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.392147 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.392147 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.392147 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.392147 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.392147 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.392147 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 12:26:15.392147 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 12:26:15.399106 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.399341 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.399567 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.399927 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.400162 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.400391 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.408862 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.409682 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.437174 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.437435 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.441380 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.441622 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.490734 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.493944 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.541235 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.541462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.543793 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.544148 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.607990 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.608216 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.608438 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.608657 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.608871 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.608958 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.609085 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.609377 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.609744 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.610072 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.610398 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.610720 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.633604 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.633933 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.634055 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.634278 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.634476 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.634566 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.634687 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.634895 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.635049 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.635379 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.635705 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.636037 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.636353 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.636674 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.646316 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.647623 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.659596 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.659596 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.659907 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.660195 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.660510 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.660811 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.660947 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.661092 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87918) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.665309 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.665309 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.665309 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.665309 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.665309 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.665309 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87917) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 12:26:15.678819 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.679024 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 12:26:15.679362 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.679562 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 12:26:15.679699 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.679875 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.680081 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.680163 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 12:26:15.680333 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.680581 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.680773 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.681077 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 12:26:15.681451 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.681843 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.682207 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.682570 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.691043 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.691339 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.691606 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.691885 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.693715 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.694116 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.694497 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.694892 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.700670 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87918) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 12:26:15.703633 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87918) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 12:26:15.703911 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.704189 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.704405 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87917) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 12:26:15.704490 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.704737 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.704995 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.705261 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.705528 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.705815 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.706118 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.706380 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.708389 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87917) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 12:26:15.708784 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.709192 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.709583 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.709996 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.710367 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.710745 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.711132 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.711509 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.711892 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.712269 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.729285 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.730810 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87918) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 12:26:15.731087 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.735682 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87918) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 12:26:15.735955 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.736234 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.740992 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.742608 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87917) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 12:26:15.743013 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.743798 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87918) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 12:26:15.744073 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.748118 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87917) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 12:26:15.748211 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87918) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 12:26:15.748415 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.748662 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.748747 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.748981 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.749182 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.749265 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.749638 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.749908 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.750171 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.757223 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87917) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 12:26:15.757665 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.761898 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87917) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 12:26:15.762300 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.762710 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.763101 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.763608 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.763997 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.764378 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.764763 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.766416 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.766691 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.770598 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87918) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 12:26:15.773721 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.774022 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.778506 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87918) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 12:26:15.781649 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87918) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 12:26:15.784582 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.784801 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.785017 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.785190 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.785332 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.785621 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.785897 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.786281 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.788849 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87917) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 12:26:15.792036 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.792341 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.796762 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87917) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 12:26:15.800492 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87917) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 12:26:15.802521 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87918) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 12:26:15.802805 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.803066 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.803324 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.805643 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.805956 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.806250 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.806537 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.806933 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.807208 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.810198 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.811923 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.812210 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.814985 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87918) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 12:26:15.815261 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.816038 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.816332 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.816612 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.827145 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87917) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 12:26:15.827444 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.827717 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.827984 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.828332 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87918) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 12:26:15.828332 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.828607 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.828764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.829035 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.829307 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.829585 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.834956 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.836715 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.837000 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.839739 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87917) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 12:26:15.840023 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.840306 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.840600 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.840882 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.845092 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87918) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 12:26:15.848084 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87918) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 12:26:15.852207 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.852372 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87917) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 12:26:15.852647 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.852930 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.853215 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.853495 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.853683 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.853831 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.854069 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.855172 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87918) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 12:26:15.855453 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.855729 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.870716 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87917) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 12:26:15.873865 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87917) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 12:26:15.878866 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.880408 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.881993 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87917) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 12:26:15.882280 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.882563 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.966318 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.968068 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87918) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 12:26:15.971195 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.971630 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.972020 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.972406 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.980669 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87918) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 12:26:15.981137 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.981532 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.989143 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87918) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 12:26:15.989696 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.990336 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.990435 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.990795 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.991217 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.991560 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.991939 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.992020 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87917) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 12:26:15.992379 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.992764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.993142 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.993524 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.993909 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.994241 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.994573 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87918) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.995108 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.995472 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.995829 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:15.996181 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:16.005211 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87917) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 12:26:16.005611 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:16.007785 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:16.016361 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87917) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 12:26:16.016836 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:16.017199 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:16.017552 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:16.017985 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:16.018344 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:16.018721 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:16.019078 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:16.019434 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:16.019782 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:16.020127 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:16.020474 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:16.020815 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:16.021151 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87917) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 12:26:16.032156 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x564885dba9c0 pid: 87918 (default app) Jul 27 12:26:16.036550 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb574a2a-b545-4342-b441-5606fed1adb6 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:16.036850 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb574a2a-b545-4342-b441-5606fed1adb6 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:16.037130 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb574a2a-b545-4342-b441-5606fed1adb6 None None] PATH_INFO: `/v3` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:16.041806 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 1/1] 10.222.0.55 () {50 vars in 791 bytes} [Wed Jul 27 12:26:16 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:16.056868 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x564885dba9c0 pid: 87917 (default app) Jul 27 12:26:24.084408 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85a224-79f7-4f36-b7e1-b273edf8fe30 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:24.084956 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85a224-79f7-4f36-b7e1-b273edf8fe30 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:24.084956 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85a224-79f7-4f36-b7e1-b273edf8fe30 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:24.086320 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 2/2] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 12:26:24.094461 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531fbf2-14b7-457f-83e3-ce88c09b376a None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:24.094895 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531fbf2-14b7-457f-83e3-ce88c09b376a None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:24.095041 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531fbf2-14b7-457f-83e3-ce88c09b376a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:24.171230 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: INFO dbcounter [None req-c531fbf2-14b7-457f-83e3-ce88c09b376a None None] Registered counter for database keystone Jul 27 12:26:24.192493 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG oslo_db.sqlalchemy.engines [None req-c531fbf2-14b7-457f-83e3-ce88c09b376a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87917) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 12:26:24.198552 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writer thread running {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 12:26:24.384762 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG passlib.handlers.bcrypt [None req-c531fbf2-14b7-457f-83e3-ce88c09b376a None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87917) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 27 12:26:24.385088 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG passlib.handlers.bcrypt [None req-c531fbf2-14b7-457f-83e3-ce88c09b376a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87917) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 27 12:26:24.439119 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-c531fbf2-14b7-457f-83e3-ce88c09b376a None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:26:24.441338 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-c531fbf2-14b7-457f-83e3-ce88c09b376a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:26:24.562271 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 1/3] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:26:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 27 12:26:24.727997 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85a224-79f7-4f36-b7e1-b273edf8fe30 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:24.804365 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: INFO dbcounter [None req-7f85a224-79f7-4f36-b7e1-b273edf8fe30 None None] Registered counter for database keystone Jul 27 12:26:24.823244 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG oslo_db.sqlalchemy.engines [None req-7f85a224-79f7-4f36-b7e1-b273edf8fe30 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87918) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 12:26:24.829381 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writer thread running {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 12:26:24.947650 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85a224-79f7-4f36-b7e1-b273edf8fe30 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:24.952681 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f141970-09f5-42c7-80bb-dbdad7bd6715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:24.953316 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f141970-09f5-42c7-80bb-dbdad7bd6715 admin admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:24.953616 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f141970-09f5-42c7-80bb-dbdad7bd6715 admin admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:24.953907 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f141970-09f5-42c7-80bb-dbdad7bd6715 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:24.962293 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f141970-09f5-42c7-80bb-dbdad7bd6715 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:25.021435 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7f141970-09f5-42c7-80bb-dbdad7bd6715 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 27 12:26:25.021803 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f141970-09f5-42c7-80bb-dbdad7bd6715 admin admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:25.032048 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 3/4] 10.222.0.55 () {58 vars in 1324 bytes} [Wed Jul 27 12:26:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 12:26:25.038832 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531fbf2-14b7-457f-83e3-ce88c09b376a None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:25.054087 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531fbf2-14b7-457f-83e3-ce88c09b376a None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:25.058547 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ec6ce-cf95-4beb-a554-5b435d3e8e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:25.059663 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ec6ce-cf95-4beb-a554-5b435d3e8e81 admin admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:25.059953 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ec6ce-cf95-4beb-a554-5b435d3e8e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:25.060234 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ec6ce-cf95-4beb-a554-5b435d3e8e81 admin admin] PATH_INFO: `/v3/projects/618eab11857d49309c9a7cb9985a7981` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:25.061881 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154ec6ce-cf95-4beb-a554-5b435d3e8e81 admin admin] RBAC: Authorizing `identity:get_project(project_id=618eab11857d49309c9a7cb9985a7981)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:25.112863 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: WARNING keystone.common.rbac_enforcer.enforcer [None req-154ec6ce-cf95-4beb-a554-5b435d3e8e81 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 27 12:26:25.113408 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154ec6ce-cf95-4beb-a554-5b435d3e8e81 admin admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:25.118062 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 2/5] 10.222.0.55 () {56 vars in 1207 bytes} [Wed Jul 27 12:26:25 2022] GET /identity/v3/projects/618eab11857d49309c9a7cb9985a7981 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:27.296670 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea13b6-f9fe-4be5-b4f4-811f047a5a93 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:27.297207 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea13b6-f9fe-4be5-b4f4-811f047a5a93 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:27.297304 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea13b6-f9fe-4be5-b4f4-811f047a5a93 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:27.302012 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 4/6] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:26:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 12:26:27.307455 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3915348-0f64-4440-82f3-88d6d3a5eac3 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:27.307877 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3915348-0f64-4440-82f3-88d6d3a5eac3 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:27.308013 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3915348-0f64-4440-82f3-88d6d3a5eac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:27.328172 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-b3915348-0f64-4440-82f3-88d6d3a5eac3 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:26:27.329721 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-b3915348-0f64-4440-82f3-88d6d3a5eac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:26:27.337392 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 3/7] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:26:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 27 12:26:27.359830 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea13b6-f9fe-4be5-b4f4-811f047a5a93 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:27.372513 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea13b6-f9fe-4be5-b4f4-811f047a5a93 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:27.376678 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0b3d0-f200-47e3-b3a5-d187ad95c1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:27.377284 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0b3d0-f200-47e3-b3a5-d187ad95c1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:27.377570 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0b3d0-f200-47e3-b3a5-d187ad95c1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:27.378533 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0b3d0-f200-47e3-b3a5-d187ad95c1e3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:27.386142 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0b3d0-f200-47e3-b3a5-d187ad95c1e3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:27.387946 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0b3d0-f200-47e3-b3a5-d187ad95c1e3 admin admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:27.396663 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 5/8] 10.222.0.55 () {58 vars in 1324 bytes} [Wed Jul 27 12:26:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 12:26:27.402109 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3915348-0f64-4440-82f3-88d6d3a5eac3 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:27.411050 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3915348-0f64-4440-82f3-88d6d3a5eac3 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:27.415339 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe8f148-f5d5-4a85-8c17-bbdafe78b8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:27.415965 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8f148-f5d5-4a85-8c17-bbdafe78b8ab admin admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:27.416247 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8f148-f5d5-4a85-8c17-bbdafe78b8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:27.416524 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8f148-f5d5-4a85-8c17-bbdafe78b8ab admin admin] PATH_INFO: `/v3/users/39c655ecdea3454d98a7abe23dc966e9` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:27.417906 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe8f148-f5d5-4a85-8c17-bbdafe78b8ab admin admin] RBAC: Authorizing `identity:get_user(user_id=39c655ecdea3454d98a7abe23dc966e9)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:27.419726 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe8f148-f5d5-4a85-8c17-bbdafe78b8ab admin admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:27.421240 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 4/9] 10.222.0.55 () {56 vars in 1198 bytes} [Wed Jul 27 12:26:27 2022] GET /identity/v3/users/39c655ecdea3454d98a7abe23dc966e9 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:29.686649 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e3697-65fc-4c4e-84f3-1f70246f291b None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:29.687170 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e3697-65fc-4c4e-84f3-1f70246f291b None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:29.687479 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e3697-65fc-4c4e-84f3-1f70246f291b None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:29.690706 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 6/10] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:26:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:26:29.696030 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f62fd-8a98-449c-a7a6-23ed686b1361 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:29.696423 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f62fd-8a98-449c-a7a6-23ed686b1361 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:29.696598 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f62fd-8a98-449c-a7a6-23ed686b1361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:29.716067 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77772a71-9289-4bde-9366-a171f25f69cc None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:29.716346 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77772a71-9289-4bde-9366-a171f25f69cc None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:29.716622 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77772a71-9289-4bde-9366-a171f25f69cc None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:29.716783 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-ae0f62fd-8a98-449c-a7a6-23ed686b1361 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:26:29.718001 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 7/11] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 12:26:29.718133 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-ae0f62fd-8a98-449c-a7a6-23ed686b1361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:26:29.723652 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80813be-9628-4b2a-99be-08ea52c90f74 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:29.723936 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80813be-9628-4b2a-99be-08ea52c90f74 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:29.724211 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80813be-9628-4b2a-99be-08ea52c90f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:29.766041 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG passlib.handlers.bcrypt [None req-f80813be-9628-4b2a-99be-08ea52c90f74 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87918) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 27 12:26:29.766461 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG passlib.handlers.bcrypt [None req-f80813be-9628-4b2a-99be-08ea52c90f74 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87918) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 27 12:26:29.799297 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 5/12] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:26:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:26:29.812209 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-f80813be-9628-4b2a-99be-08ea52c90f74 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:26:29.813845 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-f80813be-9628-4b2a-99be-08ea52c90f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:26:29.822704 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f62fd-8a98-449c-a7a6-23ed686b1361 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:29.847015 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:29.917987 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 8/13] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:26:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 12:26:29.927086 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f62fd-8a98-449c-a7a6-23ed686b1361 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:29.941637 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80813be-9628-4b2a-99be-08ea52c90f74 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:29.963614 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2957d-cd57-4eab-b996-d8ce4ce72d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:29.964262 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2957d-cd57-4eab-b996-d8ce4ce72d6b None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:29.964552 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2957d-cd57-4eab-b996-d8ce4ce72d6b None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:29.964826 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2957d-cd57-4eab-b996-d8ce4ce72d6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:29.976226 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2957d-cd57-4eab-b996-d8ce4ce72d6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:26:29.984952 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-1fc2957d-cd57-4eab-b996-d8ce4ce72d6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 12:26:29.984952 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:26:29.984952 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:26:29.984952 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:26:29.984952 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:26:29.984952 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:26:29.984952 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:26:29.984952 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:26:29.984952 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:26:29.984952 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:26:29.984952 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:26:29.984952 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:26:29.984952 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:26:29.984952 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:26:29.984952 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:26:29.984952 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:26:29.985984 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:26:29.985984 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:26:29.985984 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:26:29.985984 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:26:29.985984 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:26:29.985984 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:26:29.985984 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:26:29.985984 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:26:29.985984 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:26:29.985984 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:26:29.985984 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:26:29.985984 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:26:29.985984 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:26:29.985984 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:26:29.985984 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:26:29.985984 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:26:29.986902 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:26:29.986902 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:26:29.986902 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:26:29.986902 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:26:29.986902 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:26:29.986902 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:26:29.986902 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:26:29.986902 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:26:29.986902 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:26:29.986902 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:26:29.986902 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 12:26:29.986902 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:26:29.986902 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 6/14] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jul 27 12:26:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 12:26:29.994234 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2957d-cd57-4eab-b996-d8ce4ce72d6b None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:30.040338 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80813be-9628-4b2a-99be-08ea52c90f74 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:30.042674 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:30.074116 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:30.077153 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf77e9-22ec-446e-9f4b-df384afd6911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:30.078061 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf77e9-22ec-446e-9f4b-df384afd6911 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:30.078351 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf77e9-22ec-446e-9f4b-df384afd6911 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:30.078627 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf77e9-22ec-446e-9f4b-df384afd6911 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:30.091921 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2957d-cd57-4eab-b996-d8ce4ce72d6b None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:30.125562 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be273d-1359-4bf4-9fe2-3e77f68e1a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:30.126211 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be273d-1359-4bf4-9fe2-3e77f68e1a4c None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:30.126491 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be273d-1359-4bf4-9fe2-3e77f68e1a4c None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:30.126767 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be273d-1359-4bf4-9fe2-3e77f68e1a4c None admin] PATH_INFO: `/v3/roles` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:30.127492 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be273d-1359-4bf4-9fe2-3e77f68e1a4c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:26:30.127783 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be273d-1359-4bf4-9fe2-3e77f68e1a4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:30.129170 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be273d-1359-4bf4-9fe2-3e77f68e1a4c None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:30.140491 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 7/15] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:26:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:26:30.146053 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be273d-1359-4bf4-9fe2-3e77f68e1a4c None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:30.146495 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf77e9-22ec-446e-9f4b-df384afd6911 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:30.148027 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf77e9-22ec-446e-9f4b-df384afd6911 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:30.244968 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be273d-1359-4bf4-9fe2-3e77f68e1a4c None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:30.245333 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 9/16] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jul 27 12:26:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 12:26:30.250840 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf77e9-22ec-446e-9f4b-df384afd6911 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:30.253782 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:30.279697 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c022ae-daca-410a-aa71-191b7f70f029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:30.280342 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c022ae-daca-410a-aa71-191b7f70f029 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:30.280631 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c022ae-daca-410a-aa71-191b7f70f029 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:30.280913 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c022ae-daca-410a-aa71-191b7f70f029 None admin] PATH_INFO: `/v3/users/39c655ecdea3454d98a7abe23dc966e9` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:30.282127 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c022ae-daca-410a-aa71-191b7f70f029 None admin] RBAC: Authorizing `identity:get_user(user_id=39c655ecdea3454d98a7abe23dc966e9)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:30.283587 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c022ae-daca-410a-aa71-191b7f70f029 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:30.285764 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 8/17] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jul 27 12:26:30 2022] GET /identity/v3/users/39c655ecdea3454d98a7abe23dc966e9 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:26:30.291224 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c022ae-daca-410a-aa71-191b7f70f029 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:30.306588 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:30.350393 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf77e9-22ec-446e-9f4b-df384afd6911 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:30.385367 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46389cc5-520d-4979-8ebb-3aeebea08aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:30.386242 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46389cc5-520d-4979-8ebb-3aeebea08aec None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:30.386527 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46389cc5-520d-4979-8ebb-3aeebea08aec None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:30.386813 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46389cc5-520d-4979-8ebb-3aeebea08aec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:30.391069 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c022ae-daca-410a-aa71-191b7f70f029 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:30.405101 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46389cc5-520d-4979-8ebb-3aeebea08aec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:30.406597 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46389cc5-520d-4979-8ebb-3aeebea08aec None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:30.424481 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429372ed-eb25-46bb-a5ab-79da414aa259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:30.424959 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-46389cc5-520d-4979-8ebb-3aeebea08aec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:26:30.424959 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:26:30.424959 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:26:30.424959 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:26:30.424959 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:26:30.424959 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:26:30.424959 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:26:30.424959 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:26:30.424959 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:26:30.424959 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:26:30.424959 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:26:30.424959 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:26:30.424959 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:26:30.424959 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:26:30.424959 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:26:30.425984 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:26:30.425984 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:26:30.425984 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:26:30.425984 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:26:30.425984 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:26:30.425984 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:26:30.425984 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:26:30.425984 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:26:30.425984 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:26:30.425984 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:26:30.425984 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:26:30.425984 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:26:30.425984 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:26:30.425984 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:26:30.425984 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:26:30.425984 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:26:30.425984 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:26:30.426830 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:26:30.426830 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:26:30.426830 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:26:30.426830 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:26:30.427047 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429372ed-eb25-46bb-a5ab-79da414aa259 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:30.427047 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429372ed-eb25-46bb-a5ab-79da414aa259 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:30.427047 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429372ed-eb25-46bb-a5ab-79da414aa259 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:30.427221 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 10/18] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:26:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 12:26:30.431447 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429372ed-eb25-46bb-a5ab-79da414aa259 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:30.431921 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46389cc5-520d-4979-8ebb-3aeebea08aec None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:30.432926 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429372ed-eb25-46bb-a5ab-79da414aa259 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:30.434548 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 9/19] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:26:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:26:30.440050 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429372ed-eb25-46bb-a5ab-79da414aa259 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:30.487711 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:30.521896 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:30.531769 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46389cc5-520d-4979-8ebb-3aeebea08aec None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:30.541847 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429372ed-eb25-46bb-a5ab-79da414aa259 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:30.565582 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a76a0-6e46-481d-a041-fbde9c3ca0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:30.566227 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a76a0-6e46-481d-a041-fbde9c3ca0b0 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:30.566522 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a76a0-6e46-481d-a041-fbde9c3ca0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:30.566806 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a76a0-6e46-481d-a041-fbde9c3ca0b0 None admin] PATH_INFO: `/v3/domains` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:30.567505 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a76a0-6e46-481d-a041-fbde9c3ca0b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:26:30.567815 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a76a0-6e46-481d-a041-fbde9c3ca0b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:30.569203 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a76a0-6e46-481d-a041-fbde9c3ca0b0 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:30.574545 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb93df-5812-4743-b314-56324e9b42ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:30.575166 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb93df-5812-4743-b314-56324e9b42ff None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:30.575454 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb93df-5812-4743-b314-56324e9b42ff None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:30.575739 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb93df-5812-4743-b314-56324e9b42ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:30.576556 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fb93df-5812-4743-b314-56324e9b42ff None admin] RBAC: Adding query filter params (role.id=af00ed97066e4c72aeb6cd3d5b5d15c9, scope.domain.id=default, user.id=39c655ecdea3454d98a7abe23dc966e9) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:26:30.576869 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fb93df-5812-4743-b314-56324e9b42ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:30.578377 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fb93df-5812-4743-b314-56324e9b42ff None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:30.585724 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 10/20] 10.222.0.55 () {56 vars in 1322 bytes} [Wed Jul 27 12:26:30 2022] GET /identity/v3/role_assignments?user.id=39c655ecdea3454d98a7abe23dc966e9&scope.domain.id=default&role.id=af00ed97066e4c72aeb6cd3d5b5d15c9 => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:26:30.589003 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 11/21] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:26:33.511782 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630e872-a688-4cc6-99d8-d486fd8cba02 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:33.512390 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630e872-a688-4cc6-99d8-d486fd8cba02 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:33.512390 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630e872-a688-4cc6-99d8-d486fd8cba02 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:33.513718 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 11/22] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:26:33.519928 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da057c-46f5-403d-bdb9-3fded6e147fa None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:33.520738 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da057c-46f5-403d-bdb9-3fded6e147fa None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:33.521227 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da057c-46f5-403d-bdb9-3fded6e147fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:33.546153 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-46da057c-46f5-403d-bdb9-3fded6e147fa None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:26:33.547650 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-46da057c-46f5-403d-bdb9-3fded6e147fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:26:33.638040 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 12/23] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:26:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:26:33.674651 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630e872-a688-4cc6-99d8-d486fd8cba02 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:33.833480 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630e872-a688-4cc6-99d8-d486fd8cba02 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:33.879469 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b862512-9c02-4da1-b578-a0d8df9999a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:33.880126 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b862512-9c02-4da1-b578-a0d8df9999a4 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:33.880411 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b862512-9c02-4da1-b578-a0d8df9999a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:33.880688 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b862512-9c02-4da1-b578-a0d8df9999a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:33.895015 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b862512-9c02-4da1-b578-a0d8df9999a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:33.896494 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b862512-9c02-4da1-b578-a0d8df9999a4 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:33.899169 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:33.913507 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-9b862512-9c02-4da1-b578-a0d8df9999a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:26:33.913507 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:26:33.913507 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:26:33.913507 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:26:33.913507 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:26:33.913507 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:26:33.913507 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:26:33.913507 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:26:33.913507 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:26:33.913507 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:26:33.913507 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:26:33.913507 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:26:33.913507 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:26:33.913507 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:26:33.913507 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:26:33.914395 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:26:33.914395 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:26:33.914395 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:26:33.914395 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:26:33.914395 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:26:33.914395 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:26:33.914395 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:26:33.914395 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:26:33.914395 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:26:33.914395 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:26:33.914395 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:26:33.914395 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:26:33.914395 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:26:33.914395 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:26:33.914395 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:26:33.914395 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:26:33.914395 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:26:33.915185 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:26:33.915185 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:26:33.915185 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:26:33.915185 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:26:33.915185 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 12/24] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:26:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:26:33.920757 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da057c-46f5-403d-bdb9-3fded6e147fa None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:33.987095 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:34.057291 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da057c-46f5-403d-bdb9-3fded6e147fa None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:34.101207 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392deb0e-c33a-4240-b489-4b1b5508d13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:34.101807 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392deb0e-c33a-4240-b489-4b1b5508d13c None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:34.102091 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392deb0e-c33a-4240-b489-4b1b5508d13c None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:34.102369 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392deb0e-c33a-4240-b489-4b1b5508d13c None admin] PATH_INFO: `/v3/domains` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:34.103084 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392deb0e-c33a-4240-b489-4b1b5508d13c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:26:34.103509 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392deb0e-c33a-4240-b489-4b1b5508d13c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:34.105157 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f10feb-9055-4989-81a1-637c38c9e4ea None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:34.105435 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f10feb-9055-4989-81a1-637c38c9e4ea None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:34.105953 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f10feb-9055-4989-81a1-637c38c9e4ea None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:34.107308 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 13/25] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 12:26:34.108752 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392deb0e-c33a-4240-b489-4b1b5508d13c None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:34.119397 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16548bf2-741a-466c-a1da-519bac9c7c5a None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:34.119679 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16548bf2-741a-466c-a1da-519bac9c7c5a None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:34.120267 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16548bf2-741a-466c-a1da-519bac9c7c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:34.124276 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 13/26] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:26:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:34.125474 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e0e8b-ea66-4ebe-a7b8-a6aa621f14f2 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:34.125790 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e0e8b-ea66-4ebe-a7b8-a6aa621f14f2 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:34.126070 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e0e8b-ea66-4ebe-a7b8-a6aa621f14f2 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:34.127475 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 14/27] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:26:34.133790 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e0e8b-ea66-4ebe-a7b8-a6aa621f14f2 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:34.149646 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-16548bf2-741a-466c-a1da-519bac9c7c5a None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:26:34.149646 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-16548bf2-741a-466c-a1da-519bac9c7c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:26:34.226018 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 14/28] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:26:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 12:26:34.226681 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6c404-0791-4ab5-8e6d-daa022700697 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:34.227131 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6c404-0791-4ab5-8e6d-daa022700697 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:34.227416 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6c404-0791-4ab5-8e6d-daa022700697 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:34.229094 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 15/29] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:26:34.233620 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f3776-15fd-4396-8d61-666402ba9763 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:34.233620 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f3776-15fd-4396-8d61-666402ba9763 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:34.233620 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f3776-15fd-4396-8d61-666402ba9763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:34.254404 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-d49f3776-15fd-4396-8d61-666402ba9763 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:26:34.255718 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-d49f3776-15fd-4396-8d61-666402ba9763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:26:34.266238 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e0e8b-ea66-4ebe-a7b8-a6aa621f14f2 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:34.275038 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:34.304829 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8182e9-db97-4cf7-a9a0-9857f033a65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:34.305808 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8182e9-db97-4cf7-a9a0-9857f033a65c None admin] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:34.306295 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8182e9-db97-4cf7-a9a0-9857f033a65c None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:34.306747 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8182e9-db97-4cf7-a9a0-9857f033a65c None admin] PATH_INFO: `/v3/projects` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:34.307840 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8182e9-db97-4cf7-a9a0-9857f033a65c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:34.309703 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8182e9-db97-4cf7-a9a0-9857f033a65c None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:34.345065 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 16/30] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:26:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:26:34.351137 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e94d8d-d77b-49cb-a0ed-f6f3f8075b0e None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:34.351548 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e94d8d-d77b-49cb-a0ed-f6f3f8075b0e None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:34.351893 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e94d8d-d77b-49cb-a0ed-f6f3f8075b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:34.386759 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-48e94d8d-d77b-49cb-a0ed-f6f3f8075b0e None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:26:34.388201 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-48e94d8d-d77b-49cb-a0ed-f6f3f8075b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:26:34.443276 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:34.461302 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 17/32] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:26:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:26:34.461496 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 15/32] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jul 27 12:26:34 2022] POST /identity/v3/projects => generated 301 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 12:26:34.462380 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e94d8d-d77b-49cb-a0ed-f6f3f8075b0e None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:34.462765 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8182e9-db97-4cf7-a9a0-9857f033a65c None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:34.594604 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e94d8d-d77b-49cb-a0ed-f6f3f8075b0e None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:34.598844 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8182e9-db97-4cf7-a9a0-9857f033a65c None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:34.633539 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318262fb-de4e-4f63-be25-ee8618231201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:34.634168 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318262fb-de4e-4f63-be25-ee8618231201 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:34.634476 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318262fb-de4e-4f63-be25-ee8618231201 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:34.634757 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318262fb-de4e-4f63-be25-ee8618231201 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:34.640521 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22c5b9-7e04-4aff-9d55-eec2a738c621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:34.641344 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22c5b9-7e04-4aff-9d55-eec2a738c621 None admin] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:34.641877 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22c5b9-7e04-4aff-9d55-eec2a738c621 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:34.642161 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22c5b9-7e04-4aff-9d55-eec2a738c621 None admin] PATH_INFO: `/v3/roles` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:34.642889 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a22c5b9-7e04-4aff-9d55-eec2a738c621 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:34.644987 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a22c5b9-7e04-4aff-9d55-eec2a738c621 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:34.649392 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318262fb-de4e-4f63-be25-ee8618231201 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:26:34.654859 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-318262fb-de4e-4f63-be25-ee8618231201 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 12:26:34.654859 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:26:34.654859 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:26:34.654859 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:26:34.654859 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:26:34.654859 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:26:34.654859 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:26:34.654859 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:26:34.654859 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:26:34.654859 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:26:34.654859 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:26:34.654859 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:26:34.654859 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:26:34.654859 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:26:34.654859 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:26:34.654859 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:26:34.655810 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:26:34.655810 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:26:34.655810 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:26:34.655810 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:26:34.655810 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:26:34.655810 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:26:34.655810 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:26:34.655810 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:26:34.655810 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:26:34.655810 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:26:34.655810 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:26:34.655810 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:26:34.655810 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:26:34.655810 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:26:34.655810 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:26:34.655810 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:26:34.656638 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:26:34.656638 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:26:34.656638 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:26:34.656638 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:26:34.656638 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:26:34.656638 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:26:34.656638 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:26:34.656638 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:26:34.656638 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:26:34.656638 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:26:34.656638 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 12:26:34.656638 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:26:34.658664 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 18/33] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jul 27 12:26:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:26:34.660304 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b651779-f2df-4264-9c63-2b8befcd47ae None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:34.660597 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b651779-f2df-4264-9c63-2b8befcd47ae None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:34.661108 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b651779-f2df-4264-9c63-2b8befcd47ae None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:34.662314 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 19/34] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:26:34.666643 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 16/35] 10.222.0.55 () {60 vars in 1131 bytes} [Wed Jul 27 12:26:34 2022] POST /identity/v3/roles => generated 225 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 12:26:34.666781 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b651779-f2df-4264-9c63-2b8befcd47ae None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:34.666869 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c4af8-e271-4bfd-ac1f-091af6d4c7b4 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:34.666869 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c4af8-e271-4bfd-ac1f-091af6d4c7b4 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:34.666869 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c4af8-e271-4bfd-ac1f-091af6d4c7b4 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:34.666869 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 17/36] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:26:34.668561 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77297bba-8249-4cd4-b849-72f51e28c4de None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:34.668561 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77297bba-8249-4cd4-b849-72f51e28c4de None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:34.669521 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77297bba-8249-4cd4-b849-72f51e28c4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:34.702678 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-77297bba-8249-4cd4-b849-72f51e28c4de None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:26:34.705013 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-77297bba-8249-4cd4-b849-72f51e28c4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:26:34.725154 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:34.737463 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:34.801623 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 18/37] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:26:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 27 12:26:34.801623 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999e9f4-6257-46c8-a7b0-5c5a6d2e1c15 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:34.801623 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999e9f4-6257-46c8-a7b0-5c5a6d2e1c15 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:34.801623 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999e9f4-6257-46c8-a7b0-5c5a6d2e1c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:34.808655 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b651779-f2df-4264-9c63-2b8befcd47ae None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:34.812555 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-9999e9f4-6257-46c8-a7b0-5c5a6d2e1c15 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:26:34.813806 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-9999e9f4-6257-46c8-a7b0-5c5a6d2e1c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:26:34.851746 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25356fa9-9281-42bb-bbbd-11a2713c8dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:34.852599 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25356fa9-9281-42bb-bbbd-11a2713c8dd2 None admin] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:34.852889 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25356fa9-9281-42bb-bbbd-11a2713c8dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:34.853168 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25356fa9-9281-42bb-bbbd-11a2713c8dd2 None admin] PATH_INFO: `/v3/roles` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:34.853925 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25356fa9-9281-42bb-bbbd-11a2713c8dd2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:34.855309 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25356fa9-9281-42bb-bbbd-11a2713c8dd2 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:34.893994 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 19/38] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:26:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:26:34.894461 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999e9f4-6257-46c8-a7b0-5c5a6d2e1c15 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:34.973321 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:34.986297 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 20/39] 10.222.0.55 () {60 vars in 1131 bytes} [Wed Jul 27 12:26:34 2022] POST /identity/v3/roles => generated 223 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 12:26:34.987304 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25356fa9-9281-42bb-bbbd-11a2713c8dd2 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:34.996090 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999e9f4-6257-46c8-a7b0-5c5a6d2e1c15 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:35.038491 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a0c095-508f-4423-a1a8-1f6f04c280e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:35.039129 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0c095-508f-4423-a1a8-1f6f04c280e4 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:35.039413 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0c095-508f-4423-a1a8-1f6f04c280e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:35.039691 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0c095-508f-4423-a1a8-1f6f04c280e4 None admin] PATH_INFO: `/v3/roles` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:35.040437 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a0c095-508f-4423-a1a8-1f6f04c280e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:26:35.040739 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a0c095-508f-4423-a1a8-1f6f04c280e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:35.042223 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a0c095-508f-4423-a1a8-1f6f04c280e4 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:35.060226 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 20/40] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:26:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:35.060226 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a0c095-508f-4423-a1a8-1f6f04c280e4 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:35.108643 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25356fa9-9281-42bb-bbbd-11a2713c8dd2 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:35.118197 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:35.152463 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1a9ae-1333-4cfb-8608-b3cfb8004901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:35.153038 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1a9ae-1333-4cfb-8608-b3cfb8004901 None admin] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:35.153324 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1a9ae-1333-4cfb-8608-b3cfb8004901 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:35.154376 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1a9ae-1333-4cfb-8608-b3cfb8004901 None admin] PATH_INFO: `/v3/roles` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:35.155115 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1a9ae-1333-4cfb-8608-b3cfb8004901 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:35.156659 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1a9ae-1333-4cfb-8608-b3cfb8004901 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:35.175648 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 21/41] 10.222.0.55 () {60 vars in 1131 bytes} [Wed Jul 27 12:26:34 2022] POST /identity/v3/roles => generated 219 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 12:26:35.176661 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1a9ae-1333-4cfb-8608-b3cfb8004901 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:35.176962 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a0c095-508f-4423-a1a8-1f6f04c280e4 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:35.220841 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cffb41-b822-4703-8e72-0855d0338612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:35.222035 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cffb41-b822-4703-8e72-0855d0338612 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:35.222241 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cffb41-b822-4703-8e72-0855d0338612 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:35.222527 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cffb41-b822-4703-8e72-0855d0338612 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:35.223815 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cffb41-b822-4703-8e72-0855d0338612 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:35.225297 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cffb41-b822-4703-8e72-0855d0338612 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:35.229641 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 21/42] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:26:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:35.233853 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cffb41-b822-4703-8e72-0855d0338612 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:35.250772 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:35.319099 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1a9ae-1333-4cfb-8608-b3cfb8004901 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:35.362945 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b69921-7d0a-4d3b-b787-304f7b2ea7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:35.363608 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b69921-7d0a-4d3b-b787-304f7b2ea7cb None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:35.363897 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b69921-7d0a-4d3b-b787-304f7b2ea7cb None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:35.364181 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b69921-7d0a-4d3b-b787-304f7b2ea7cb None admin] PATH_INFO: `/v3/users/39c655ecdea3454d98a7abe23dc966e9` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:35.365441 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cffb41-b822-4703-8e72-0855d0338612 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:35.365756 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b69921-7d0a-4d3b-b787-304f7b2ea7cb None admin] RBAC: Authorizing `identity:get_user(user_id=39c655ecdea3454d98a7abe23dc966e9)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:35.367217 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b69921-7d0a-4d3b-b787-304f7b2ea7cb None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:35.368840 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 22/43] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jul 27 12:26:35 2022] GET /identity/v3/users/39c655ecdea3454d98a7abe23dc966e9 => generated 247 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:35.374815 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b69921-7d0a-4d3b-b787-304f7b2ea7cb None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:35.409643 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff590bdb-d6f6-4516-978f-b861232011ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:35.410208 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff590bdb-d6f6-4516-978f-b861232011ec None admin] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:35.410493 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff590bdb-d6f6-4516-978f-b861232011ec None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:35.410762 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff590bdb-d6f6-4516-978f-b861232011ec None admin] PATH_INFO: `/v3/projects` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:35.411454 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff590bdb-d6f6-4516-978f-b861232011ec None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:35.412894 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff590bdb-d6f6-4516-978f-b861232011ec None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:35.417104 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:35.440338 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 22/44] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jul 27 12:26:35 2022] POST /identity/v3/projects => generated 312 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 12:26:35.494722 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b69921-7d0a-4d3b-b787-304f7b2ea7cb None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:35.531509 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe6ee1-3c63-4eec-b5ef-db085ac9fbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:35.532185 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe6ee1-3c63-4eec-b5ef-db085ac9fbcf None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:35.532472 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe6ee1-3c63-4eec-b5ef-db085ac9fbcf None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:35.532753 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe6ee1-3c63-4eec-b5ef-db085ac9fbcf None admin] PATH_INFO: `/v3/domains/default` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:35.534555 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe6ee1-3c63-4eec-b5ef-db085ac9fbcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:35.536020 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe6ee1-3c63-4eec-b5ef-db085ac9fbcf None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:35.542455 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 23/45] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:26:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:26:35.543885 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff590bdb-d6f6-4516-978f-b861232011ec None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:35.606636 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:35.650672 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff590bdb-d6f6-4516-978f-b861232011ec None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:35.683968 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66670ddc-56fe-4190-b3d5-bf82a6671d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:35.684583 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66670ddc-56fe-4190-b3d5-bf82a6671d37 None admin] REQUEST_METHOD: `PUT` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:35.684870 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66670ddc-56fe-4190-b3d5-bf82a6671d37 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:35.685159 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66670ddc-56fe-4190-b3d5-bf82a6671d37 None admin] PATH_INFO: `/v3/domains/default/users/39c655ecdea3454d98a7abe23dc966e9/roles/af00ed97066e4c72aeb6cd3d5b5d15c9` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:35.687410 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66670ddc-56fe-4190-b3d5-bf82a6671d37 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=39c655ecdea3454d98a7abe23dc966e9, role_id=af00ed97066e4c72aeb6cd3d5b5d15c9)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:35.689317 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66670ddc-56fe-4190-b3d5-bf82a6671d37 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:35.703613 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 23/46] 10.222.0.55 () {58 vars in 1361 bytes} [Wed Jul 27 12:26:35 2022] PUT /identity/v3/domains/default/users/39c655ecdea3454d98a7abe23dc966e9/roles/af00ed97066e4c72aeb6cd3d5b5d15c9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 12:26:37.707060 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae73ae8-6a30-4370-b71c-4e64b0ae1c5b None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:37.707532 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae73ae8-6a30-4370-b71c-4e64b0ae1c5b None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:37.707625 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae73ae8-6a30-4370-b71c-4e64b0ae1c5b None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:37.708975 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 24/47] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:26:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:26:37.714252 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60707a7e-7172-451a-92bf-081673bda1de None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:37.714660 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60707a7e-7172-451a-92bf-081673bda1de None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:37.714815 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60707a7e-7172-451a-92bf-081673bda1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:37.733019 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-60707a7e-7172-451a-92bf-081673bda1de None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:26:37.734228 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-60707a7e-7172-451a-92bf-081673bda1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:26:37.801384 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 24/48] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:26:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:26:37.825232 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae73ae8-6a30-4370-b71c-4e64b0ae1c5b None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:37.924318 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae73ae8-6a30-4370-b71c-4e64b0ae1c5b None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:37.925853 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:37.954376 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac575387-d6e6-4b8f-82e4-975369bb9c98 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:37.954599 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac575387-d6e6-4b8f-82e4-975369bb9c98 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:37.954886 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac575387-d6e6-4b8f-82e4-975369bb9c98 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:37.956885 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 25/49] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:26:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:26:37.959085 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872ca7e-77da-42b6-b9bc-ae8d12b8e032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:37.959736 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872ca7e-77da-42b6-b9bc-ae8d12b8e032 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:37.960360 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872ca7e-77da-42b6-b9bc-ae8d12b8e032 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:37.960360 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872ca7e-77da-42b6-b9bc-ae8d12b8e032 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:37.961528 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872ca7e-77da-42b6-b9bc-ae8d12b8e032 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:37.962036 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b78fa-17d4-4469-8881-c60dc45005f6 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:37.962329 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b78fa-17d4-4469-8881-c60dc45005f6 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:37.962635 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b78fa-17d4-4469-8881-c60dc45005f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:37.963019 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872ca7e-77da-42b6-b9bc-ae8d12b8e032 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:37.964604 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 25/50] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:26:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:37.969809 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872ca7e-77da-42b6-b9bc-ae8d12b8e032 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:37.981724 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-dd8b78fa-17d4-4469-8881-c60dc45005f6 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:26:37.982989 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-dd8b78fa-17d4-4469-8881-c60dc45005f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:26:38.031677 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:38.057643 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 26/51] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:26:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 12:26:38.071448 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872ca7e-77da-42b6-b9bc-ae8d12b8e032 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:38.079035 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b78fa-17d4-4469-8881-c60dc45005f6 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:38.105813 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94a4c6-0f7d-42c4-9bf1-f45e8facee00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:38.106444 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94a4c6-0f7d-42c4-9bf1-f45e8facee00 None admin] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:38.106735 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94a4c6-0f7d-42c4-9bf1-f45e8facee00 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:38.107021 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94a4c6-0f7d-42c4-9bf1-f45e8facee00 None admin] PATH_INFO: `/v3/projects` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:38.107706 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f94a4c6-0f7d-42c4-9bf1-f45e8facee00 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:38.109173 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f94a4c6-0f7d-42c4-9bf1-f45e8facee00 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:38.137446 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 26/52] 10.222.0.55 () {60 vars in 1140 bytes} [Wed Jul 27 12:26:37 2022] POST /identity/v3/projects => generated 298 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 12:26:38.187847 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b78fa-17d4-4469-8881-c60dc45005f6 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:38.224886 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0aaadc-6065-40ae-abaf-fc32fcd4e107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:38.225470 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0aaadc-6065-40ae-abaf-fc32fcd4e107 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:38.225797 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0aaadc-6065-40ae-abaf-fc32fcd4e107 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:38.226082 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0aaadc-6065-40ae-abaf-fc32fcd4e107 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:38.239230 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0aaadc-6065-40ae-abaf-fc32fcd4e107 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:26:38.246873 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-bf0aaadc-6065-40ae-abaf-fc32fcd4e107 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 12:26:38.246873 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:26:38.246873 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:26:38.246873 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:26:38.246873 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:26:38.246873 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:26:38.246873 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:26:38.246873 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:26:38.246873 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:26:38.246873 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:26:38.246873 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:26:38.246873 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:26:38.246873 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:26:38.246873 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:26:38.246873 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:26:38.246873 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:26:38.248088 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:26:38.248088 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:26:38.248088 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:26:38.248088 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:26:38.248088 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:26:38.248088 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:26:38.248088 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:26:38.248088 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:26:38.248088 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:26:38.248088 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:26:38.248088 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:26:38.248088 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:26:38.248088 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:26:38.248088 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:26:38.248088 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:26:38.248088 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:26:38.248907 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:26:38.248907 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:26:38.248907 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:26:38.248907 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:26:38.248907 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:26:38.248907 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:26:38.248907 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:26:38.248907 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:26:38.248907 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:26:38.248907 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:26:38.248907 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 12:26:38.248907 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:26:38.248907 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 27/53] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jul 27 12:26:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 12:26:38.256294 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94a4c6-0f7d-42c4-9bf1-f45e8facee00 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:38.283174 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:38.360227 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94a4c6-0f7d-42c4-9bf1-f45e8facee00 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:38.393451 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1edec1-54b6-445c-a331-02bb42537a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:38.394117 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1edec1-54b6-445c-a331-02bb42537a22 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:38.394402 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1edec1-54b6-445c-a331-02bb42537a22 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:38.394680 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1edec1-54b6-445c-a331-02bb42537a22 None admin] PATH_INFO: `/v3/roles` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:38.395400 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1edec1-54b6-445c-a331-02bb42537a22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:26:38.395763 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1edec1-54b6-445c-a331-02bb42537a22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:38.397157 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1edec1-54b6-445c-a331-02bb42537a22 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:38.405223 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 27/54] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:26:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:38.411544 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0aaadc-6065-40ae-abaf-fc32fcd4e107 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:38.458423 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:38.516062 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0aaadc-6065-40ae-abaf-fc32fcd4e107 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:38.548713 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597769dc-13fd-44ca-a2f3-b0613ba9860f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:38.549993 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597769dc-13fd-44ca-a2f3-b0613ba9860f None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:38.550276 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597769dc-13fd-44ca-a2f3-b0613ba9860f None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:38.550548 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597769dc-13fd-44ca-a2f3-b0613ba9860f None admin] PATH_INFO: `/v3/users/39c655ecdea3454d98a7abe23dc966e9` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:38.551736 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597769dc-13fd-44ca-a2f3-b0613ba9860f None admin] RBAC: Authorizing `identity:get_user(user_id=39c655ecdea3454d98a7abe23dc966e9)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:38.553184 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597769dc-13fd-44ca-a2f3-b0613ba9860f None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:38.554801 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 28/55] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jul 27 12:26:38 2022] GET /identity/v3/users/39c655ecdea3454d98a7abe23dc966e9 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:38.560220 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1edec1-54b6-445c-a331-02bb42537a22 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:38.646741 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:38.664415 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1edec1-54b6-445c-a331-02bb42537a22 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:38.701208 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671bc4da-57a7-403b-958d-4f18322b38f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:38.701898 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bc4da-57a7-403b-958d-4f18322b38f2 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:38.702184 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bc4da-57a7-403b-958d-4f18322b38f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:38.702461 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bc4da-57a7-403b-958d-4f18322b38f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:38.703629 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671bc4da-57a7-403b-958d-4f18322b38f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:38.705079 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671bc4da-57a7-403b-958d-4f18322b38f2 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:38.707390 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 28/56] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:26:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:38.713323 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597769dc-13fd-44ca-a2f3-b0613ba9860f None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:38.811447 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597769dc-13fd-44ca-a2f3-b0613ba9860f None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:38.820068 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:38.844488 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a838857-f7cf-44ff-bb5c-c48040b7be85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:38.845102 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a838857-f7cf-44ff-bb5c-c48040b7be85 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:38.845389 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a838857-f7cf-44ff-bb5c-c48040b7be85 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:38.845700 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a838857-f7cf-44ff-bb5c-c48040b7be85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:38.847112 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a838857-f7cf-44ff-bb5c-c48040b7be85 None admin] RBAC: Adding query filter params (role.id=af00ed97066e4c72aeb6cd3d5b5d15c9, scope.domain.id=default, user.id=39c655ecdea3454d98a7abe23dc966e9) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:26:38.847423 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a838857-f7cf-44ff-bb5c-c48040b7be85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:38.848894 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a838857-f7cf-44ff-bb5c-c48040b7be85 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:38.856664 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 29/57] 10.222.0.55 () {56 vars in 1322 bytes} [Wed Jul 27 12:26:38 2022] GET /identity/v3/role_assignments?user.id=39c655ecdea3454d98a7abe23dc966e9&scope.domain.id=default&role.id=af00ed97066e4c72aeb6cd3d5b5d15c9 => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:40.370885 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908b2c7-3968-4814-99c8-c8549ac2266f None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:40.371431 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908b2c7-3968-4814-99c8-c8549ac2266f None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:40.371431 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908b2c7-3968-4814-99c8-c8549ac2266f None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:40.372792 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 29/58] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:26:40.378363 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bc752-9d13-40df-a966-0368b75989ea None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:40.378764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bc752-9d13-40df-a966-0368b75989ea None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:40.378926 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bc752-9d13-40df-a966-0368b75989ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:40.396661 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-1d6bc752-9d13-40df-a966-0368b75989ea None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:26:40.397887 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-1d6bc752-9d13-40df-a966-0368b75989ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:26:40.462463 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 30/59] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:26:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:26:40.494229 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0908b2c7-3968-4814-99c8-c8549ac2266f None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:40.600372 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0908b2c7-3968-4814-99c8-c8549ac2266f None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:40.633080 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708aad4-55fe-4c36-9f02-9d06e8227313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:40.633688 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708aad4-55fe-4c36-9f02-9d06e8227313 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:40.633977 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708aad4-55fe-4c36-9f02-9d06e8227313 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:40.634277 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708aad4-55fe-4c36-9f02-9d06e8227313 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:40.635412 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708aad4-55fe-4c36-9f02-9d06e8227313 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:40.636857 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708aad4-55fe-4c36-9f02-9d06e8227313 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:40.638485 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 30/60] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:26:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:40.644074 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6bc752-9d13-40df-a966-0368b75989ea None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:40.741618 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6bc752-9d13-40df-a966-0368b75989ea None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:40.743120 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:40.775645 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261f025-1476-4c63-8a99-9b0d006eea90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:40.776258 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261f025-1476-4c63-8a99-9b0d006eea90 None admin] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:40.776542 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261f025-1476-4c63-8a99-9b0d006eea90 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:40.776818 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261f025-1476-4c63-8a99-9b0d006eea90 None admin] PATH_INFO: `/v3/users` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:40.777486 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9261f025-1476-4c63-8a99-9b0d006eea90 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:40.778959 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9261f025-1476-4c63-8a99-9b0d006eea90 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:40.805670 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 31/61] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jul 27 12:26:40 2022] POST /identity/v3/users => generated 275 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 12:26:44.213454 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a987222-5bf7-40c0-ae6a-1905760dbecc None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:44.213999 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a987222-5bf7-40c0-ae6a-1905760dbecc None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:44.214075 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a987222-5bf7-40c0-ae6a-1905760dbecc None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:44.215417 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 31/62] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:26:44.230151 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4d866-311c-4f50-a277-c28d426f94f8 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:44.230593 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4d866-311c-4f50-a277-c28d426f94f8 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:44.230715 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4d866-311c-4f50-a277-c28d426f94f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:44.258745 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-a1a4d866-311c-4f50-a277-c28d426f94f8 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:26:44.260215 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-a1a4d866-311c-4f50-a277-c28d426f94f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:26:44.315400 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633ddf3-ec15-4750-a2d2-f7c0d5f07039 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:44.316035 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633ddf3-ec15-4750-a2d2-f7c0d5f07039 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:44.316520 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633ddf3-ec15-4750-a2d2-f7c0d5f07039 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:44.321686 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 32/63] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:26:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:26:44.324102 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce9599-f1b8-4840-9bc0-4552377dceb3 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:44.324639 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce9599-f1b8-4840-9bc0-4552377dceb3 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:44.325118 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce9599-f1b8-4840-9bc0-4552377dceb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:44.345135 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-f9ce9599-f1b8-4840-9bc0-4552377dceb3 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:26:44.347392 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-f9ce9599-f1b8-4840-9bc0-4552377dceb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:26:44.363964 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:44.368009 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 32/64] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:26:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:26:44.416528 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a4d866-311c-4f50-a277-c28d426f94f8 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:44.441357 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 33/65] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:26:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:26:44.468722 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce9599-f1b8-4840-9bc0-4552377dceb3 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:44.585484 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce9599-f1b8-4840-9bc0-4552377dceb3 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:44.601719 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:44.620891 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a4d866-311c-4f50-a277-c28d426f94f8 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:44.627120 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0ff83-531e-409d-afb8-71561fc6e7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:44.627985 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0ff83-531e-409d-afb8-71561fc6e7ce None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:44.628464 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0ff83-531e-409d-afb8-71561fc6e7ce None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:44.628902 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0ff83-531e-409d-afb8-71561fc6e7ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:44.640816 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed0ff83-531e-409d-afb8-71561fc6e7ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:26:44.647080 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-8ed0ff83-531e-409d-afb8-71561fc6e7ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 12:26:44.647080 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:26:44.647080 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:26:44.647080 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:26:44.647080 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:26:44.647080 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:26:44.647080 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:26:44.647080 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:26:44.647080 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:26:44.647080 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:26:44.647080 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:26:44.647080 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:26:44.647080 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:26:44.647080 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:26:44.647080 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:26:44.647080 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:26:44.648137 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:26:44.648137 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:26:44.648137 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:26:44.648137 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:26:44.648137 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:26:44.648137 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:26:44.648137 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:26:44.648137 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:26:44.648137 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:26:44.648137 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:26:44.648137 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:26:44.648137 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:26:44.648137 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:26:44.648137 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:26:44.648137 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:26:44.648137 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:26:44.649082 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:26:44.649082 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:26:44.649082 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:26:44.649082 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:26:44.649082 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:26:44.649082 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:26:44.649082 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:26:44.649082 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:26:44.649082 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:26:44.649082 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:26:44.649082 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 12:26:44.649082 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:26:44.651082 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 34/66] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jul 27 12:26:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:26:44.652947 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8b6cd-10c3-4e4d-b0e0-6449c0395edc None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:44.653372 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8b6cd-10c3-4e4d-b0e0-6449c0395edc None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:44.653855 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8b6cd-10c3-4e4d-b0e0-6449c0395edc None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:44.655344 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 35/67] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:26:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:26:44.657091 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f80de-7aa2-4052-b57b-10cb48efec52 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:44.657375 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f80de-7aa2-4052-b57b-10cb48efec52 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:44.657765 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f80de-7aa2-4052-b57b-10cb48efec52 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:44.659476 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 36/68] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:26:44.660297 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f80de-7aa2-4052-b57b-10cb48efec52 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:44.670982 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea30cb-9987-40c4-ab89-f01628b994ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:44.672331 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea30cb-9987-40c4-ab89-f01628b994ec None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:44.672803 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea30cb-9987-40c4-ab89-f01628b994ec None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:44.673325 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:44.673777 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea30cb-9987-40c4-ab89-f01628b994ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:44.685828 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea30cb-9987-40c4-ab89-f01628b994ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:26:44.695476 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-f8ea30cb-9987-40c4-ab89-f01628b994ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 12:26:44.695476 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:26:44.695476 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:26:44.695476 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:26:44.695476 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:26:44.695476 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:26:44.695476 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:26:44.695476 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:26:44.695476 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:26:44.695476 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:26:44.695476 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:26:44.695476 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:26:44.695476 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:26:44.695476 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:26:44.695476 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:26:44.695476 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:26:44.696326 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:26:44.696326 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:26:44.696326 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:26:44.696326 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:26:44.696326 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:26:44.696326 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:26:44.696326 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:26:44.696326 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:26:44.696326 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:26:44.696326 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:26:44.696326 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:26:44.696326 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:26:44.696326 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:26:44.696326 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:26:44.696326 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:26:44.696326 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:26:44.697066 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:26:44.697066 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:26:44.697066 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:26:44.697066 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:26:44.697066 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:26:44.697066 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:26:44.697066 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:26:44.697066 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:26:44.697066 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:26:44.697066 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:26:44.697066 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 12:26:44.697066 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:26:44.697066 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 33/69] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:26:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 12:26:44.698403 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8d175-ec20-4e39-88ea-69a13094a0fe None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:44.698893 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8d175-ec20-4e39-88ea-69a13094a0fe None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:44.699178 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8d175-ec20-4e39-88ea-69a13094a0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:44.716975 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-50e8d175-ec20-4e39-88ea-69a13094a0fe None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:26:44.717994 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-50e8d175-ec20-4e39-88ea-69a13094a0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:26:44.785247 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f80de-7aa2-4052-b57b-10cb48efec52 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:44.785448 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 34/70] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:26:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:26:44.790702 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca9f51-cab8-4a6f-8d39-cbeb3f878c50 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:44.791151 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca9f51-cab8-4a6f-8d39-cbeb3f878c50 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:44.791643 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca9f51-cab8-4a6f-8d39-cbeb3f878c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:44.812115 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-86ca9f51-cab8-4a6f-8d39-cbeb3f878c50 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:26:44.813304 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-86ca9f51-cab8-4a6f-8d39-cbeb3f878c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:26:44.822429 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7c413-2952-4d92-a041-bd4896bad892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:44.823175 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7c413-2952-4d92-a041-bd4896bad892 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:44.823508 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7c413-2952-4d92-a041-bd4896bad892 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:44.823793 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7c413-2952-4d92-a041-bd4896bad892 None admin] PATH_INFO: `/v3/roles` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:44.824513 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd7c413-2952-4d92-a041-bd4896bad892 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:26:44.824818 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd7c413-2952-4d92-a041-bd4896bad892 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:44.826261 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd7c413-2952-4d92-a041-bd4896bad892 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:44.835175 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 37/71] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:26:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:44.835955 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7c413-2952-4d92-a041-bd4896bad892 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:44.893812 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 35/72] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:26:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:26:44.894988 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca9f51-cab8-4a6f-8d39-cbeb3f878c50 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:44.912048 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:44.921257 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:44.954544 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7c413-2952-4d92-a041-bd4896bad892 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:44.991751 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec981d-911d-4b47-8a8e-446050dbea22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:44.992373 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec981d-911d-4b47-8a8e-446050dbea22 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:44.992660 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec981d-911d-4b47-8a8e-446050dbea22 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:44.992941 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec981d-911d-4b47-8a8e-446050dbea22 None admin] PATH_INFO: `/v3/roles` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:44.993686 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ec981d-911d-4b47-8a8e-446050dbea22 None admin] RBAC: Adding query filter params (name=member) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:26:44.993995 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ec981d-911d-4b47-8a8e-446050dbea22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:44.995367 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ec981d-911d-4b47-8a8e-446050dbea22 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:45.004344 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 38/73] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jul 27 12:26:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:45.005153 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec981d-911d-4b47-8a8e-446050dbea22 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:45.015692 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca9f51-cab8-4a6f-8d39-cbeb3f878c50 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:45.050619 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd8a4f-e3a7-4829-a99f-24e766bcf70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:45.051202 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd8a4f-e3a7-4829-a99f-24e766bcf70c None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:45.051488 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd8a4f-e3a7-4829-a99f-24e766bcf70c None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:45.051767 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd8a4f-e3a7-4829-a99f-24e766bcf70c None admin] PATH_INFO: `/v3/roles/member` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:45.061765 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd8a4f-e3a7-4829-a99f-24e766bcf70c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:26:45.066747 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-2acd8a4f-e3a7-4829-a99f-24e766bcf70c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 12:26:45.066747 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:26:45.066747 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:26:45.066747 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:26:45.066747 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:26:45.066747 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:26:45.066747 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:26:45.066747 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:26:45.066747 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:26:45.066747 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:26:45.066747 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:26:45.066747 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:26:45.066747 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:26:45.066747 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:26:45.066747 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:26:45.066747 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:26:45.067738 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:26:45.067738 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:26:45.067738 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:26:45.067738 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:26:45.067738 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:26:45.067738 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:26:45.067738 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:26:45.067738 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:26:45.067738 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:26:45.067738 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:26:45.067738 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:26:45.067738 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:26:45.067738 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:26:45.067738 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:26:45.067738 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:26:45.067738 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:26:45.068686 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:26:45.068686 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:26:45.068686 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:26:45.068686 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:26:45.068686 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:26:45.068686 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:26:45.068686 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:26:45.068686 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:26:45.068686 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:26:45.068686 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:26:45.068686 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 12:26:45.068686 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:26:45.068686 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 36/74] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:26:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:26:45.068686 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd8a4f-e3a7-4829-a99f-24e766bcf70c None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:45.104897 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec981d-911d-4b47-8a8e-446050dbea22 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:45.135566 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:45.139206 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7916e3-b1c1-4860-bc93-3e555559d546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:45.139943 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7916e3-b1c1-4860-bc93-3e555559d546 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:45.140240 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7916e3-b1c1-4860-bc93-3e555559d546 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:45.140530 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7916e3-b1c1-4860-bc93-3e555559d546 None admin] PATH_INFO: `/v3/users/39c655ecdea3454d98a7abe23dc966e9` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:45.141759 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7916e3-b1c1-4860-bc93-3e555559d546 None admin] RBAC: Authorizing `identity:get_user(user_id=39c655ecdea3454d98a7abe23dc966e9)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:45.143828 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7916e3-b1c1-4860-bc93-3e555559d546 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:45.145438 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 39/75] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jul 27 12:26:45 2022] GET /identity/v3/users/39c655ecdea3454d98a7abe23dc966e9 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:45.146247 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7916e3-b1c1-4860-bc93-3e555559d546 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:45.148748 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:45.169856 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd8a4f-e3a7-4829-a99f-24e766bcf70c None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:45.203321 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716478c2-c451-4938-834c-c158c9bb3966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:45.204044 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716478c2-c451-4938-834c-c158c9bb3966 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:45.204404 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716478c2-c451-4938-834c-c158c9bb3966 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:45.204716 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716478c2-c451-4938-834c-c158c9bb3966 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:45.215911 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716478c2-c451-4938-834c-c158c9bb3966 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:26:45.220982 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-716478c2-c451-4938-834c-c158c9bb3966 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 12:26:45.220982 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:26:45.220982 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:26:45.220982 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:26:45.220982 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:26:45.220982 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:26:45.220982 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:26:45.220982 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:26:45.220982 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:26:45.220982 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:26:45.220982 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:26:45.220982 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:26:45.220982 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:26:45.220982 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:26:45.220982 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:26:45.220982 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:26:45.222534 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:26:45.222534 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:26:45.222534 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:26:45.222534 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:26:45.222534 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:26:45.222534 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:26:45.222534 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:26:45.222534 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:26:45.222534 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:26:45.222534 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:26:45.222534 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:26:45.222534 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:26:45.222534 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:26:45.222534 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:26:45.222534 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:26:45.222534 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:26:45.223344 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:26:45.223344 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:26:45.223344 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:26:45.223344 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:26:45.223344 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:26:45.223344 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:26:45.223344 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:26:45.223344 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:26:45.223344 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:26:45.223344 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:26:45.223344 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 12:26:45.223344 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:26:45.223344 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 37/76] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jul 27 12:26:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:26:45.223966 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1aa5f2-23b7-4db8-b844-14640660c433 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:45.224449 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1aa5f2-23b7-4db8-b844-14640660c433 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:45.224449 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1aa5f2-23b7-4db8-b844-14640660c433 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:45.225680 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 38/77] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:26:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:26:45.226423 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1aa5f2-23b7-4db8-b844-14640660c433 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:45.259299 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7916e3-b1c1-4860-bc93-3e555559d546 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:45.293691 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a3dc0-5c41-4753-8627-20ecc8c50e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:45.294340 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a3dc0-5c41-4753-8627-20ecc8c50e90 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:45.294625 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a3dc0-5c41-4753-8627-20ecc8c50e90 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:45.294908 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a3dc0-5c41-4753-8627-20ecc8c50e90 None admin] PATH_INFO: `/v3/users/4af0ab4ee85144758573e3303fe9cf81` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:45.308308 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a3dc0-5c41-4753-8627-20ecc8c50e90 None admin] RBAC: Authorizing `identity:get_user(user_id=4af0ab4ee85144758573e3303fe9cf81)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:45.309735 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a3dc0-5c41-4753-8627-20ecc8c50e90 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:45.311368 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 40/78] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jul 27 12:26:45 2022] GET /identity/v3/users/4af0ab4ee85144758573e3303fe9cf81 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:45.312175 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a3dc0-5c41-4753-8627-20ecc8c50e90 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:45.332098 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1aa5f2-23b7-4db8-b844-14640660c433 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:45.359046 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:45.367748 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec42007-be0d-4ae5-a299-292440d0bb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:45.368369 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec42007-be0d-4ae5-a299-292440d0bb0b None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:45.368657 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec42007-be0d-4ae5-a299-292440d0bb0b None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:45.368938 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec42007-be0d-4ae5-a299-292440d0bb0b None admin] PATH_INFO: `/v3/roles` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:45.369687 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec42007-be0d-4ae5-a299-292440d0bb0b None admin] RBAC: Adding query filter params (name=member) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:26:45.370002 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec42007-be0d-4ae5-a299-292440d0bb0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:45.371387 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec42007-be0d-4ae5-a299-292440d0bb0b None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:45.373169 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:45.379645 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 39/79] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jul 27 12:26:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:45.380707 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec42007-be0d-4ae5-a299-292440d0bb0b None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:45.413989 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a3dc0-5c41-4753-8627-20ecc8c50e90 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:45.446464 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381fa958-87c2-456d-b412-e0e99dd352c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:45.447085 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381fa958-87c2-456d-b412-e0e99dd352c8 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:45.447378 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381fa958-87c2-456d-b412-e0e99dd352c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:45.447661 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381fa958-87c2-456d-b412-e0e99dd352c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:45.476898 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec42007-be0d-4ae5-a299-292440d0bb0b None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:45.509151 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149859d-3148-4d01-9df9-fa9240283858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:45.509783 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149859d-3148-4d01-9df9-fa9240283858 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:45.510068 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149859d-3148-4d01-9df9-fa9240283858 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:45.510348 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149859d-3148-4d01-9df9-fa9240283858 None admin] PATH_INFO: `/v3/roles` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:45.511047 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149859d-3148-4d01-9df9-fa9240283858 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:26:45.511350 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149859d-3148-4d01-9df9-fa9240283858 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:45.512728 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149859d-3148-4d01-9df9-fa9240283858 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:45.513433 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381fa958-87c2-456d-b412-e0e99dd352c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:45.514936 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381fa958-87c2-456d-b412-e0e99dd352c8 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:45.521188 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 40/80] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jul 27 12:26:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:45.522428 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff70d7-9823-48bb-8ae9-c864a867ddef None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:45.522719 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff70d7-9823-48bb-8ae9-c864a867ddef None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:45.523003 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff70d7-9823-48bb-8ae9-c864a867ddef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:45.539855 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-85ff70d7-9823-48bb-8ae9-c864a867ddef None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:26:45.541036 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-85ff70d7-9823-48bb-8ae9-c864a867ddef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:26:45.575137 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:45.589260 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:45.609527 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 41/81] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:26:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:26:45.610489 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff70d7-9823-48bb-8ae9-c864a867ddef None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:45.629192 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 41/82] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jul 27 12:26:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 12:26:45.629192 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381fa958-87c2-456d-b412-e0e99dd352c8 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:45.708700 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff70d7-9823-48bb-8ae9-c864a867ddef None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:45.727234 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381fa958-87c2-456d-b412-e0e99dd352c8 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:45.742774 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac851ca-445d-4dd9-9aef-616576bd5c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:45.743422 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac851ca-445d-4dd9-9aef-616576bd5c4e None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:45.743705 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac851ca-445d-4dd9-9aef-616576bd5c4e None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:45.743984 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac851ca-445d-4dd9-9aef-616576bd5c4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:45.760922 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99298aca-2302-4542-9fe8-8d9b3fb81069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:45.761570 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99298aca-2302-4542-9fe8-8d9b3fb81069 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:45.761884 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99298aca-2302-4542-9fe8-8d9b3fb81069 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:45.762162 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99298aca-2302-4542-9fe8-8d9b3fb81069 None admin] PATH_INFO: `/v3/users/4af0ab4ee85144758573e3303fe9cf81` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:45.763325 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99298aca-2302-4542-9fe8-8d9b3fb81069 None admin] RBAC: Authorizing `identity:get_user(user_id=4af0ab4ee85144758573e3303fe9cf81)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:45.764788 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99298aca-2302-4542-9fe8-8d9b3fb81069 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:45.766418 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 42/83] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jul 27 12:26:45 2022] GET /identity/v3/users/4af0ab4ee85144758573e3303fe9cf81 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:45.771033 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99298aca-2302-4542-9fe8-8d9b3fb81069 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:45.793645 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:45.795964 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:45.812577 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac851ca-445d-4dd9-9aef-616576bd5c4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:45.814095 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac851ca-445d-4dd9-9aef-616576bd5c4e None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:45.866812 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99298aca-2302-4542-9fe8-8d9b3fb81069 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:45.900140 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad127bb-2b72-49eb-a040-28228a87151b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:45.900777 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad127bb-2b72-49eb-a040-28228a87151b None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:45.901060 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad127bb-2b72-49eb-a040-28228a87151b None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:45.901335 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad127bb-2b72-49eb-a040-28228a87151b None admin] PATH_INFO: `/v3/users/4af0ab4ee85144758573e3303fe9cf81` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:45.902523 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad127bb-2b72-49eb-a040-28228a87151b None admin] RBAC: Authorizing `identity:get_user(user_id=4af0ab4ee85144758573e3303fe9cf81)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:45.903952 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad127bb-2b72-49eb-a040-28228a87151b None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:45.905538 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 43/84] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jul 27 12:26:45 2022] GET /identity/v3/users/4af0ab4ee85144758573e3303fe9cf81 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:45.906389 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad127bb-2b72-49eb-a040-28228a87151b None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:45.914931 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 42/85] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jul 27 12:26:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 12:26:45.915686 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac851ca-445d-4dd9-9aef-616576bd5c4e None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:45.995669 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:46.001311 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:46.008716 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad127bb-2b72-49eb-a040-28228a87151b None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:46.014134 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac851ca-445d-4dd9-9aef-616576bd5c4e None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:46.041734 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc87ecd-f2d9-462b-9fab-001494b316ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:46.042373 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc87ecd-f2d9-462b-9fab-001494b316ea None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:46.042653 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc87ecd-f2d9-462b-9fab-001494b316ea None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:46.042931 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc87ecd-f2d9-462b-9fab-001494b316ea None admin] PATH_INFO: `/v3/projects/66779a17edc9443c8c1afeca9d6f3b11` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:46.044068 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc87ecd-f2d9-462b-9fab-001494b316ea None admin] RBAC: Authorizing `identity:get_project(project_id=66779a17edc9443c8c1afeca9d6f3b11)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:46.045499 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc87ecd-f2d9-462b-9fab-001494b316ea None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:46.047174 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 44/86] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jul 27 12:26:45 2022] GET /identity/v3/projects/66779a17edc9443c8c1afeca9d6f3b11 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:46.047381 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3dd1f5-769e-4240-989b-49f1442024b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:46.047936 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc87ecd-f2d9-462b-9fab-001494b316ea None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:46.048029 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3dd1f5-769e-4240-989b-49f1442024b5 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:46.048304 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3dd1f5-769e-4240-989b-49f1442024b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:46.048586 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3dd1f5-769e-4240-989b-49f1442024b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:46.049827 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3dd1f5-769e-4240-989b-49f1442024b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:46.051283 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3dd1f5-769e-4240-989b-49f1442024b5 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:46.057094 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 43/87] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:26:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:46.057094 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3dd1f5-769e-4240-989b-49f1442024b5 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:46.147103 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc87ecd-f2d9-462b-9fab-001494b316ea None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:46.157538 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3dd1f5-769e-4240-989b-49f1442024b5 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:46.180095 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8f185-dbb1-4e6b-ab10-41da68796b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:46.180720 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8f185-dbb1-4e6b-ab10-41da68796b9e None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:46.181012 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8f185-dbb1-4e6b-ab10-41da68796b9e None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:46.181295 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8f185-dbb1-4e6b-ab10-41da68796b9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:46.190979 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ce1ac-c91a-4968-b671-9df79dfb6c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:46.191599 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ce1ac-c91a-4968-b671-9df79dfb6c47 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:46.191886 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ce1ac-c91a-4968-b671-9df79dfb6c47 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:46.192167 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ce1ac-c91a-4968-b671-9df79dfb6c47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:46.210483 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:46.212150 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:46.251732 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8f185-dbb1-4e6b-ab10-41da68796b9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:46.253306 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8f185-dbb1-4e6b-ab10-41da68796b9e None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:46.262611 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ce1ac-c91a-4968-b671-9df79dfb6c47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:46.264075 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ce1ac-c91a-4968-b671-9df79dfb6c47 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:46.349750 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 45/88] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jul 27 12:26:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 12:26:46.350682 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8f185-dbb1-4e6b-ab10-41da68796b9e None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:46.365560 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 44/89] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jul 27 12:26:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 12:26:46.366412 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ce1ac-c91a-4968-b671-9df79dfb6c47 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:46.413237 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:46.414088 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:46.450834 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8f185-dbb1-4e6b-ab10-41da68796b9e None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:46.463215 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ce1ac-c91a-4968-b671-9df79dfb6c47 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:46.484230 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d136585-f088-4ce7-a1f3-d72e1727da9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:46.484869 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d136585-f088-4ce7-a1f3-d72e1727da9b None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:46.485154 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d136585-f088-4ce7-a1f3-d72e1727da9b None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:46.485433 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d136585-f088-4ce7-a1f3-d72e1727da9b None admin] PATH_INFO: `/v3/projects/66779a17edc9443c8c1afeca9d6f3b11` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:46.486691 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d136585-f088-4ce7-a1f3-d72e1727da9b None admin] RBAC: Authorizing `identity:get_project(project_id=66779a17edc9443c8c1afeca9d6f3b11)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:46.488148 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d136585-f088-4ce7-a1f3-d72e1727da9b None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:46.489842 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 46/90] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jul 27 12:26:46 2022] GET /identity/v3/projects/66779a17edc9443c8c1afeca9d6f3b11 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:46.490859 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d136585-f088-4ce7-a1f3-d72e1727da9b None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:46.497256 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23fd80-7f9d-4a69-9319-e203f3f2f5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:46.497911 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23fd80-7f9d-4a69-9319-e203f3f2f5dc None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:46.498204 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23fd80-7f9d-4a69-9319-e203f3f2f5dc None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:46.498487 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23fd80-7f9d-4a69-9319-e203f3f2f5dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:46.499289 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23fd80-7f9d-4a69-9319-e203f3f2f5dc None admin] RBAC: Adding query filter params (role.id=af00ed97066e4c72aeb6cd3d5b5d15c9, scope.project.id=66779a17edc9443c8c1afeca9d6f3b11, user.id=39c655ecdea3454d98a7abe23dc966e9) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:26:46.499606 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23fd80-7f9d-4a69-9319-e203f3f2f5dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:46.501034 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23fd80-7f9d-4a69-9319-e203f3f2f5dc None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:46.507100 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 45/91] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jul 27 12:26:46 2022] GET /identity/v3/role_assignments?user.id=39c655ecdea3454d98a7abe23dc966e9&scope.project.id=66779a17edc9443c8c1afeca9d6f3b11&role.id=af00ed97066e4c72aeb6cd3d5b5d15c9 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:46.507886 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23fd80-7f9d-4a69-9319-e203f3f2f5dc None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:46.618857 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23fd80-7f9d-4a69-9319-e203f3f2f5dc None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:46.619069 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d136585-f088-4ce7-a1f3-d72e1727da9b None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:46.635223 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:46.656875 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:46.661242 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc068d19-30a4-4deb-8175-dada9fe5f233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:46.661951 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc068d19-30a4-4deb-8175-dada9fe5f233 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:46.662247 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc068d19-30a4-4deb-8175-dada9fe5f233 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:46.662531 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc068d19-30a4-4deb-8175-dada9fe5f233 None admin] PATH_INFO: `/v3/projects/c264bf60c6da40cbb53c275c5ca014fd` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:46.665702 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc068d19-30a4-4deb-8175-dada9fe5f233 None admin] RBAC: Authorizing `identity:get_project(project_id=c264bf60c6da40cbb53c275c5ca014fd)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:46.665702 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc068d19-30a4-4deb-8175-dada9fe5f233 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:46.666869 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb748b76-ff87-4821-b6eb-854c69bf5950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:46.666994 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 46/92] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jul 27 12:26:46 2022] GET /identity/v3/projects/c264bf60c6da40cbb53c275c5ca014fd => generated 312 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:46.667805 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc068d19-30a4-4deb-8175-dada9fe5f233 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:46.672348 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb748b76-ff87-4821-b6eb-854c69bf5950 None admin] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:46.672645 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb748b76-ff87-4821-b6eb-854c69bf5950 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:46.672932 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb748b76-ff87-4821-b6eb-854c69bf5950 None admin] PATH_INFO: `/v3/users` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:46.673797 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb748b76-ff87-4821-b6eb-854c69bf5950 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:46.675362 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb748b76-ff87-4821-b6eb-854c69bf5950 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:46.705337 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 47/93] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jul 27 12:26:46 2022] POST /identity/v3/users => generated 289 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 12:26:46.706376 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb748b76-ff87-4821-b6eb-854c69bf5950 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:46.798876 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc068d19-30a4-4deb-8175-dada9fe5f233 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:46.835930 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb748b76-ff87-4821-b6eb-854c69bf5950 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:46.840918 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f577396-710c-4638-a99e-188ea3a2f1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:46.841922 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f577396-710c-4638-a99e-188ea3a2f1ec None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:46.842355 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f577396-710c-4638-a99e-188ea3a2f1ec None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:46.842779 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f577396-710c-4638-a99e-188ea3a2f1ec None admin] PATH_INFO: `/v3/projects/66779a17edc9443c8c1afeca9d6f3b11` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:46.844235 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f577396-710c-4638-a99e-188ea3a2f1ec None admin] RBAC: Authorizing `identity:get_project(project_id=66779a17edc9443c8c1afeca9d6f3b11)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:46.846114 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f577396-710c-4638-a99e-188ea3a2f1ec None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:46.848278 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 47/94] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jul 27 12:26:46 2022] GET /identity/v3/projects/66779a17edc9443c8c1afeca9d6f3b11 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:46.849339 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f577396-710c-4638-a99e-188ea3a2f1ec None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:46.877490 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c8551-51e5-4e69-b87c-a39b7570a993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:46.878322 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c8551-51e5-4e69-b87c-a39b7570a993 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:46.878708 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c8551-51e5-4e69-b87c-a39b7570a993 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:46.879230 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c8551-51e5-4e69-b87c-a39b7570a993 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:46.880114 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43c8551-51e5-4e69-b87c-a39b7570a993 None admin] RBAC: Adding query filter params (role.id=2136377433854360927c578b39f16e6f, scope.project.id=66779a17edc9443c8c1afeca9d6f3b11, user.id=4af0ab4ee85144758573e3303fe9cf81) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:26:46.880592 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43c8551-51e5-4e69-b87c-a39b7570a993 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:46.882184 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43c8551-51e5-4e69-b87c-a39b7570a993 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:46.888654 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 48/95] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jul 27 12:26:46 2022] GET /identity/v3/role_assignments?user.id=4af0ab4ee85144758573e3303fe9cf81&scope.project.id=66779a17edc9443c8c1afeca9d6f3b11&role.id=2136377433854360927c578b39f16e6f => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:46.890449 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c8551-51e5-4e69-b87c-a39b7570a993 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:46.913791 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:46.966171 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:46.978816 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f577396-710c-4638-a99e-188ea3a2f1ec None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:47.021064 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a5ae9-871d-44eb-aaf7-35716b4e56f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:47.022300 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a5ae9-871d-44eb-aaf7-35716b4e56f0 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:47.023128 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a5ae9-871d-44eb-aaf7-35716b4e56f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:47.023865 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a5ae9-871d-44eb-aaf7-35716b4e56f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:47.025041 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a5ae9-871d-44eb-aaf7-35716b4e56f0 None admin] RBAC: Adding query filter params (role.id=2136377433854360927c578b39f16e6f, scope.project.id=c264bf60c6da40cbb53c275c5ca014fd, user.id=4af0ab4ee85144758573e3303fe9cf81) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:26:47.025470 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c8551-51e5-4e69-b87c-a39b7570a993 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:47.025833 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a5ae9-871d-44eb-aaf7-35716b4e56f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:47.028595 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a5ae9-871d-44eb-aaf7-35716b4e56f0 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:47.035551 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 48/96] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jul 27 12:26:46 2022] GET /identity/v3/role_assignments?user.id=4af0ab4ee85144758573e3303fe9cf81&scope.project.id=c264bf60c6da40cbb53c275c5ca014fd&role.id=2136377433854360927c578b39f16e6f => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:47.071387 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0355c8-6561-4018-9848-c997ab5d5a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:47.072052 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0355c8-6561-4018-9848-c997ab5d5a63 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:47.072337 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0355c8-6561-4018-9848-c997ab5d5a63 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:47.072617 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0355c8-6561-4018-9848-c997ab5d5a63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:47.073444 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0355c8-6561-4018-9848-c997ab5d5a63 None admin] RBAC: Adding query filter params (role.id=28c0b3a6358343c398e7df818529a952, scope.project.id=66779a17edc9443c8c1afeca9d6f3b11, user.id=4af0ab4ee85144758573e3303fe9cf81) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:26:47.073804 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0355c8-6561-4018-9848-c997ab5d5a63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:47.075430 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0355c8-6561-4018-9848-c997ab5d5a63 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:47.082487 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 49/97] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jul 27 12:26:46 2022] GET /identity/v3/role_assignments?user.id=4af0ab4ee85144758573e3303fe9cf81&scope.project.id=66779a17edc9443c8c1afeca9d6f3b11&role.id=28c0b3a6358343c398e7df818529a952 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:49.371090 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489340e-94bd-42f4-88b9-086fb2fd3215 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:49.372175 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489340e-94bd-42f4-88b9-086fb2fd3215 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:49.372697 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489340e-94bd-42f4-88b9-086fb2fd3215 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:49.374292 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 49/98] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:26:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:26:49.380296 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed19e0f-6af9-4ad8-b0d2-2d96e81657ef None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:49.381250 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed19e0f-6af9-4ad8-b0d2-2d96e81657ef None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:49.381790 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed19e0f-6af9-4ad8-b0d2-2d96e81657ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:49.404630 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-bed19e0f-6af9-4ad8-b0d2-2d96e81657ef None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:26:49.406211 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-bed19e0f-6af9-4ad8-b0d2-2d96e81657ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:26:49.483022 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 50/99] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:26:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:26:49.518812 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489340e-94bd-42f4-88b9-086fb2fd3215 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:49.652001 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489340e-94bd-42f4-88b9-086fb2fd3215 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:49.672741 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:49.701182 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81bfaf1-3981-4c8d-8345-ba64e277e415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:49.701875 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81bfaf1-3981-4c8d-8345-ba64e277e415 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:49.702171 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81bfaf1-3981-4c8d-8345-ba64e277e415 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:49.702456 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81bfaf1-3981-4c8d-8345-ba64e277e415 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:49.715821 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81bfaf1-3981-4c8d-8345-ba64e277e415 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:26:49.720866 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-f81bfaf1-3981-4c8d-8345-ba64e277e415 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 12:26:49.720866 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:26:49.720866 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:26:49.720866 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:26:49.720866 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:26:49.720866 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:26:49.720866 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:26:49.720866 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:26:49.720866 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:26:49.720866 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:26:49.720866 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:26:49.720866 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:26:49.720866 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:26:49.720866 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:26:49.720866 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:26:49.720866 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:26:49.721758 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:26:49.721758 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:26:49.721758 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:26:49.721758 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:26:49.721758 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:26:49.721758 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:26:49.721758 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:26:49.721758 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:26:49.721758 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:26:49.721758 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:26:49.721758 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:26:49.721758 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:26:49.721758 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:26:49.721758 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:26:49.721758 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:26:49.721758 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:26:49.722940 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:26:49.722940 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:26:49.722940 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:26:49.722940 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:26:49.722940 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:26:49.722940 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:26:49.722940 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:26:49.722940 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:26:49.722940 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:26:49.722940 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:26:49.722940 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 12:26:49.722940 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:26:49.722940 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 50/100] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jul 27 12:26:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:26:49.727906 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed19e0f-6af9-4ad8-b0d2-2d96e81657ef None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:49.808689 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:49.890191 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed19e0f-6af9-4ad8-b0d2-2d96e81657ef None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:49.943329 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2af81-1edf-4ee4-bc03-2c0197356989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:49.943899 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2af81-1edf-4ee4-bc03-2c0197356989 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:49.944183 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2af81-1edf-4ee4-bc03-2c0197356989 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:49.944461 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2af81-1edf-4ee4-bc03-2c0197356989 None admin] PATH_INFO: `/v3/roles` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:49.945189 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f2af81-1edf-4ee4-bc03-2c0197356989 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:26:49.945493 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f2af81-1edf-4ee4-bc03-2c0197356989 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:49.947323 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f2af81-1edf-4ee4-bc03-2c0197356989 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:49.949636 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21c763-fc7b-4c77-acef-f2397d1fbc1e None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:49.949636 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21c763-fc7b-4c77-acef-f2397d1fbc1e None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:49.949636 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21c763-fc7b-4c77-acef-f2397d1fbc1e None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:49.951034 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 51/101] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:26:49.956932 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8f309-98da-4be1-93fd-766d77db8c9b None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:49.957483 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8f309-98da-4be1-93fd-766d77db8c9b None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:49.958013 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8f309-98da-4be1-93fd-766d77db8c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:49.965180 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 51/102] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:26:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:49.972236 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2af81-1edf-4ee4-bc03-2c0197356989 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:49.986195 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-95d8f309-98da-4be1-93fd-766d77db8c9b None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:26:49.987915 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-95d8f309-98da-4be1-93fd-766d77db8c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:26:50.126969 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2af81-1edf-4ee4-bc03-2c0197356989 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:50.137941 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:50.162731 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295f23f-05c6-4c25-bcea-87b3784ea4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:50.163754 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295f23f-05c6-4c25-bcea-87b3784ea4c5 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:50.164259 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295f23f-05c6-4c25-bcea-87b3784ea4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:50.164624 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 52/103] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:26:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 12:26:50.164979 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295f23f-05c6-4c25-bcea-87b3784ea4c5 None admin] PATH_INFO: `/v3/users/39c655ecdea3454d98a7abe23dc966e9` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:50.169614 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abb4b0-3095-4e43-9a47-4631b85bdb85 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:50.169614 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abb4b0-3095-4e43-9a47-4631b85bdb85 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:50.169614 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abb4b0-3095-4e43-9a47-4631b85bdb85 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:50.169614 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 53/104] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:26:50.169614 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb779f-fbbd-428d-bf9b-341cced94d88 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:50.169614 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb779f-fbbd-428d-bf9b-341cced94d88 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:50.170033 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb779f-fbbd-428d-bf9b-341cced94d88 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:50.171025 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295f23f-05c6-4c25-bcea-87b3784ea4c5 None admin] RBAC: Authorizing `identity:get_user(user_id=39c655ecdea3454d98a7abe23dc966e9)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:50.171261 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 54/105] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:26:50.173057 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295f23f-05c6-4c25-bcea-87b3784ea4c5 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:50.173164 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa0960-c353-4c16-9316-49738c858071 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:50.173358 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa0960-c353-4c16-9316-49738c858071 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:50.173663 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa0960-c353-4c16-9316-49738c858071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:50.176197 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 52/106] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jul 27 12:26:49 2022] GET /identity/v3/users/39c655ecdea3454d98a7abe23dc966e9 => generated 247 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:26:50.177664 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b91941-ecd5-4c2b-98dd-e3bf493c2370 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:50.178155 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b91941-ecd5-4c2b-98dd-e3bf493c2370 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:50.178655 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b91941-ecd5-4c2b-98dd-e3bf493c2370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:50.193162 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-f0aa0960-c353-4c16-9316-49738c858071 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:26:50.194868 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-f0aa0960-c353-4c16-9316-49738c858071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:26:50.214682 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-b8b91941-ecd5-4c2b-98dd-e3bf493c2370 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:26:50.216207 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-b8b91941-ecd5-4c2b-98dd-e3bf493c2370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:26:50.274756 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 55/107] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:26:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:26:50.275793 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa0960-c353-4c16-9316-49738c858071 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:50.298132 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 53/108] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:26:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:26:50.300566 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b91941-ecd5-4c2b-98dd-e3bf493c2370 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:50.312290 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:50.392390 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa0960-c353-4c16-9316-49738c858071 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:50.428016 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a71d0-7211-450c-b16f-e9ab3610411b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:50.428670 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a71d0-7211-450c-b16f-e9ab3610411b None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:50.428959 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a71d0-7211-450c-b16f-e9ab3610411b None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:50.429237 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a71d0-7211-450c-b16f-e9ab3610411b None admin] PATH_INFO: `/v3/projects/66779a17edc9443c8c1afeca9d6f3b11` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:50.429777 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b91941-ecd5-4c2b-98dd-e3bf493c2370 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:50.430474 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a71d0-7211-450c-b16f-e9ab3610411b None admin] RBAC: Authorizing `identity:get_project(project_id=66779a17edc9443c8c1afeca9d6f3b11)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:50.431912 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a71d0-7211-450c-b16f-e9ab3610411b None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:50.433932 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 56/109] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jul 27 12:26:50 2022] GET /identity/v3/projects/66779a17edc9443c8c1afeca9d6f3b11 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:50.434720 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a71d0-7211-450c-b16f-e9ab3610411b None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:50.439959 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:50.470540 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e97cd-49ca-4772-8199-7acffc2f84bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:50.472987 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e97cd-49ca-4772-8199-7acffc2f84bd None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:50.473489 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e97cd-49ca-4772-8199-7acffc2f84bd None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:50.474065 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e97cd-49ca-4772-8199-7acffc2f84bd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:50.489086 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e97cd-49ca-4772-8199-7acffc2f84bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:26:50.496920 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-8c2e97cd-49ca-4772-8199-7acffc2f84bd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 12:26:50.496920 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:26:50.496920 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:26:50.496920 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:26:50.496920 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:26:50.496920 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:26:50.496920 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:26:50.496920 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:26:50.496920 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:26:50.496920 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:26:50.496920 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:26:50.496920 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:26:50.496920 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:26:50.496920 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:26:50.496920 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:26:50.496920 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:26:50.497844 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:26:50.497844 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:26:50.497844 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:26:50.497844 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:26:50.497844 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:26:50.497844 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:26:50.497844 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:26:50.497844 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:26:50.497844 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:26:50.497844 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:26:50.497844 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:26:50.497844 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:26:50.497844 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:26:50.497844 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:26:50.497844 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:26:50.497844 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:26:50.498620 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:26:50.498620 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:26:50.498620 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:26:50.498620 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:26:50.498620 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:26:50.498620 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:26:50.498620 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:26:50.498620 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:26:50.498620 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:26:50.498620 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:26:50.498620 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 12:26:50.498620 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:26:50.499211 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 54/110] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jul 27 12:26:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:26:50.500295 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e97cd-49ca-4772-8199-7acffc2f84bd None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:50.551538 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a71d0-7211-450c-b16f-e9ab3610411b None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:50.553207 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:50.591356 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a717a-75c4-42ba-ac40-129c2c9b4ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:50.592037 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a717a-75c4-42ba-ac40-129c2c9b4ed6 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:50.592355 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a717a-75c4-42ba-ac40-129c2c9b4ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:50.592582 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a717a-75c4-42ba-ac40-129c2c9b4ed6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:50.606087 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a717a-75c4-42ba-ac40-129c2c9b4ed6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:26:50.611764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-ce5a717a-75c4-42ba-ac40-129c2c9b4ed6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 12:26:50.611764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:26:50.611764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:26:50.611764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:26:50.611764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:26:50.611764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:26:50.611764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:26:50.611764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:26:50.611764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:26:50.611764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:26:50.611764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:26:50.611764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:26:50.611764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:26:50.611764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:26:50.611764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:26:50.611764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:26:50.612774 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:26:50.612774 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:26:50.612774 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:26:50.612774 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:26:50.612774 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:26:50.612774 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:26:50.612774 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:26:50.612774 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:26:50.612774 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:26:50.612774 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:26:50.612774 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:26:50.612774 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:26:50.612774 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:26:50.612774 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:26:50.612774 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:26:50.612774 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:26:50.613526 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:26:50.613526 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:26:50.613526 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:26:50.613526 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:26:50.613526 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:26:50.613526 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:26:50.613526 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:26:50.613526 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:26:50.613526 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:26:50.613526 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:26:50.613526 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 12:26:50.613526 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:26:50.613526 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 57/111] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:26:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:26:50.614208 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a717a-75c4-42ba-ac40-129c2c9b4ed6 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:50.655401 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e97cd-49ca-4772-8199-7acffc2f84bd None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:50.703037 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae8007-b0ae-4035-bc10-695c16cdfaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:50.703991 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae8007-b0ae-4035-bc10-695c16cdfaaf None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:50.704498 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae8007-b0ae-4035-bc10-695c16cdfaaf None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:50.704985 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae8007-b0ae-4035-bc10-695c16cdfaaf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:50.719830 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eae8007-b0ae-4035-bc10-695c16cdfaaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:26:50.727831 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-7eae8007-b0ae-4035-bc10-695c16cdfaaf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 12:26:50.727831 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:26:50.727831 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:26:50.727831 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:26:50.727831 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:26:50.727831 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:26:50.727831 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:26:50.727831 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:26:50.727831 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:26:50.727831 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:26:50.727831 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:26:50.727831 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:26:50.727831 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:26:50.727831 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:26:50.727831 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:26:50.727831 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:26:50.728684 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:26:50.728684 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:26:50.728684 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:26:50.728684 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:26:50.728684 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:26:50.728684 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:26:50.728684 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:26:50.728684 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:26:50.728684 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:26:50.728684 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:26:50.728684 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:26:50.728684 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:26:50.728684 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:26:50.728684 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:26:50.728684 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:26:50.728684 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:26:50.729495 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:26:50.729495 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:26:50.729495 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:26:50.729495 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:26:50.729495 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:26:50.729495 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:26:50.729495 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:26:50.729495 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:26:50.729495 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:26:50.729495 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:26:50.729495 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 12:26:50.729495 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:26:50.735927 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 55/112] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:26:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:26:50.735927 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae8007-b0ae-4035-bc10-695c16cdfaaf None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:50.742129 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a717a-75c4-42ba-ac40-129c2c9b4ed6 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:50.768222 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:50.780689 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db0063-f58b-4289-8d76-afd6fb854edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:50.781798 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db0063-f58b-4289-8d76-afd6fb854edc None admin] REQUEST_METHOD: `PUT` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:50.782085 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db0063-f58b-4289-8d76-afd6fb854edc None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:50.782362 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db0063-f58b-4289-8d76-afd6fb854edc None admin] PATH_INFO: `/v3/projects/66779a17edc9443c8c1afeca9d6f3b11/users/39c655ecdea3454d98a7abe23dc966e9/roles/af00ed97066e4c72aeb6cd3d5b5d15c9` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:50.785075 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db0063-f58b-4289-8d76-afd6fb854edc None admin] RBAC: Authorizing `identity:create_grant(project_id=66779a17edc9443c8c1afeca9d6f3b11, user_id=39c655ecdea3454d98a7abe23dc966e9, role_id=af00ed97066e4c72aeb6cd3d5b5d15c9)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:50.786633 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db0063-f58b-4289-8d76-afd6fb854edc None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:50.803980 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 58/113] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jul 27 12:26:50 2022] PUT /identity/v3/projects/66779a17edc9443c8c1afeca9d6f3b11/users/39c655ecdea3454d98a7abe23dc966e9/roles/af00ed97066e4c72aeb6cd3d5b5d15c9 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 12:26:50.804584 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db0063-f58b-4289-8d76-afd6fb854edc None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:50.850490 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:50.859869 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae8007-b0ae-4035-bc10-695c16cdfaaf None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:50.902385 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14998e-565d-4729-aedb-d216bc3db659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:50.903133 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14998e-565d-4729-aedb-d216bc3db659 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:50.903421 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14998e-565d-4729-aedb-d216bc3db659 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:50.903697 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14998e-565d-4729-aedb-d216bc3db659 None admin] PATH_INFO: `/v3/roles` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:50.904441 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e14998e-565d-4729-aedb-d216bc3db659 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:26:50.904747 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e14998e-565d-4729-aedb-d216bc3db659 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:50.906467 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e14998e-565d-4729-aedb-d216bc3db659 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:50.916616 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 56/114] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jul 27 12:26:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:50.917493 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14998e-565d-4729-aedb-d216bc3db659 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:50.975167 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db0063-f58b-4289-8d76-afd6fb854edc None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:51.016401 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb5cfc-f8ee-43f1-bf04-f3b939a15f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:51.016950 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb5cfc-f8ee-43f1-bf04-f3b939a15f31 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:51.017239 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb5cfc-f8ee-43f1-bf04-f3b939a15f31 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:51.017533 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb5cfc-f8ee-43f1-bf04-f3b939a15f31 None admin] PATH_INFO: `/v3/roles` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:51.018323 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb5cfc-f8ee-43f1-bf04-f3b939a15f31 None admin] RBAC: Adding query filter params (name=member) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:26:51.018792 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb5cfc-f8ee-43f1-bf04-f3b939a15f31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:51.019998 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb5cfc-f8ee-43f1-bf04-f3b939a15f31 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:51.022560 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:51.028662 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 59/115] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jul 27 12:26:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:51.029908 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fdc03-3621-4726-9c9a-763f69a6bef3 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:51.030263 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fdc03-3621-4726-9c9a-763f69a6bef3 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:51.030545 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fdc03-3621-4726-9c9a-763f69a6bef3 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:51.033827 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 60/116] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:26:51.033827 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fdc03-3621-4726-9c9a-763f69a6bef3 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:51.042613 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14998e-565d-4729-aedb-d216bc3db659 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:51.079053 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e79d4d-5285-4326-9908-3dd6dd067221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:51.079819 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e79d4d-5285-4326-9908-3dd6dd067221 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:51.080002 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e79d4d-5285-4326-9908-3dd6dd067221 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:51.080823 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e79d4d-5285-4326-9908-3dd6dd067221 None admin] PATH_INFO: `/v3/roles` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:51.081550 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e79d4d-5285-4326-9908-3dd6dd067221 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:26:51.081891 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e79d4d-5285-4326-9908-3dd6dd067221 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:51.083292 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e79d4d-5285-4326-9908-3dd6dd067221 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:51.091812 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 57/117] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jul 27 12:26:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:51.095464 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf51155-8bbf-41ed-8b35-34745d703b50 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:51.096497 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf51155-8bbf-41ed-8b35-34745d703b50 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:51.096934 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf51155-8bbf-41ed-8b35-34745d703b50 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:51.098554 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 58/118] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:26:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:26:51.102978 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf51155-8bbf-41ed-8b35-34745d703b50 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:51.127656 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:51.146186 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fdc03-3621-4726-9c9a-763f69a6bef3 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:51.184519 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219f197-483f-432d-af42-cc2344bd0ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:51.185149 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219f197-483f-432d-af42-cc2344bd0ca9 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:51.185435 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219f197-483f-432d-af42-cc2344bd0ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:51.185737 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219f197-483f-432d-af42-cc2344bd0ca9 None admin] PATH_INFO: `/v3/users/4af0ab4ee85144758573e3303fe9cf81` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:51.186912 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219f197-483f-432d-af42-cc2344bd0ca9 None admin] RBAC: Authorizing `identity:get_user(user_id=4af0ab4ee85144758573e3303fe9cf81)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:51.188367 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219f197-483f-432d-af42-cc2344bd0ca9 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:51.190524 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 61/119] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jul 27 12:26:51 2022] GET /identity/v3/users/4af0ab4ee85144758573e3303fe9cf81 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:51.196272 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493f81d-e941-4c26-a5e1-0d820fb7b923 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:51.196561 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493f81d-e941-4c26-a5e1-0d820fb7b923 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:51.196840 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493f81d-e941-4c26-a5e1-0d820fb7b923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:51.213464 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf51155-8bbf-41ed-8b35-34745d703b50 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:51.214427 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-6493f81d-e941-4c26-a5e1-0d820fb7b923 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:26:51.215611 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-6493f81d-e941-4c26-a5e1-0d820fb7b923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:26:51.257195 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320794a1-c6c1-45db-9aa8-9ce8c57e6fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:51.258244 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320794a1-c6c1-45db-9aa8-9ce8c57e6fcc None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:51.259085 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320794a1-c6c1-45db-9aa8-9ce8c57e6fcc None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:51.259568 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320794a1-c6c1-45db-9aa8-9ce8c57e6fcc None admin] PATH_INFO: `/v3/users/4af0ab4ee85144758573e3303fe9cf81` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:51.261365 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320794a1-c6c1-45db-9aa8-9ce8c57e6fcc None admin] RBAC: Authorizing `identity:get_user(user_id=4af0ab4ee85144758573e3303fe9cf81)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:51.263621 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320794a1-c6c1-45db-9aa8-9ce8c57e6fcc None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:51.266120 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 59/120] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jul 27 12:26:51 2022] GET /identity/v3/users/4af0ab4ee85144758573e3303fe9cf81 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:51.267327 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320794a1-c6c1-45db-9aa8-9ce8c57e6fcc None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:51.285640 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 62/121] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:26:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:26:51.286309 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b2a39-fed2-459e-84b3-0cfcb8dce9ea None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:51.286599 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b2a39-fed2-459e-84b3-0cfcb8dce9ea None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:51.288443 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b2a39-fed2-459e-84b3-0cfcb8dce9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:51.297422 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:51.306112 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-d09b2a39-fed2-459e-84b3-0cfcb8dce9ea None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:26:51.307373 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-d09b2a39-fed2-459e-84b3-0cfcb8dce9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:26:51.380695 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 63/122] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:26:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:26:51.381379 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b2a39-fed2-459e-84b3-0cfcb8dce9ea None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:51.396063 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:51.398674 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320794a1-c6c1-45db-9aa8-9ce8c57e6fcc None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:51.435528 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf39266-ea1f-4d12-8852-a7c97fdb0549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:51.436162 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf39266-ea1f-4d12-8852-a7c97fdb0549 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:51.436447 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf39266-ea1f-4d12-8852-a7c97fdb0549 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:51.436727 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf39266-ea1f-4d12-8852-a7c97fdb0549 None admin] PATH_INFO: `/v3/users/b9f646e5981e416d99cb32ee7727ef22` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:51.451958 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf39266-ea1f-4d12-8852-a7c97fdb0549 None admin] RBAC: Authorizing `identity:get_user(user_id=b9f646e5981e416d99cb32ee7727ef22)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:51.453437 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf39266-ea1f-4d12-8852-a7c97fdb0549 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:51.455877 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 60/123] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jul 27 12:26:51 2022] GET /identity/v3/users/b9f646e5981e416d99cb32ee7727ef22 => generated 289 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:51.456552 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf39266-ea1f-4d12-8852-a7c97fdb0549 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:51.490111 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b2a39-fed2-459e-84b3-0cfcb8dce9ea None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:51.526312 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9f1cd-1af2-4d11-9a6f-ba2e6893593b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:51.526968 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9f1cd-1af2-4d11-9a6f-ba2e6893593b None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:51.527258 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9f1cd-1af2-4d11-9a6f-ba2e6893593b None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:51.527542 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9f1cd-1af2-4d11-9a6f-ba2e6893593b None admin] PATH_INFO: `/v3/projects/66779a17edc9443c8c1afeca9d6f3b11` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:51.528707 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd9f1cd-1af2-4d11-9a6f-ba2e6893593b None admin] RBAC: Authorizing `identity:get_project(project_id=66779a17edc9443c8c1afeca9d6f3b11)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:51.530205 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd9f1cd-1af2-4d11-9a6f-ba2e6893593b None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:51.531886 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 64/124] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jul 27 12:26:51 2022] GET /identity/v3/projects/66779a17edc9443c8c1afeca9d6f3b11 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:51.532656 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9f1cd-1af2-4d11-9a6f-ba2e6893593b None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:51.549809 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:51.575408 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf39266-ea1f-4d12-8852-a7c97fdb0549 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:51.613306 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dcbfea-6675-417f-b7d0-6c4384bf42f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:51.614054 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcbfea-6675-417f-b7d0-6c4384bf42f2 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:51.614341 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcbfea-6675-417f-b7d0-6c4384bf42f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:51.614621 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcbfea-6675-417f-b7d0-6c4384bf42f2 None admin] PATH_INFO: `/v3/projects/66779a17edc9443c8c1afeca9d6f3b11` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:51.615834 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:51.616871 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dcbfea-6675-417f-b7d0-6c4384bf42f2 None admin] RBAC: Authorizing `identity:get_project(project_id=66779a17edc9443c8c1afeca9d6f3b11)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:51.618570 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dcbfea-6675-417f-b7d0-6c4384bf42f2 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:51.624886 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 61/125] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jul 27 12:26:51 2022] GET /identity/v3/projects/66779a17edc9443c8c1afeca9d6f3b11 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:51.624886 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dcbfea-6675-417f-b7d0-6c4384bf42f2 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:51.642574 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9f1cd-1af2-4d11-9a6f-ba2e6893593b None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:51.685634 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ee4bd-a95a-4160-9ca6-6833cbd3fce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:51.685843 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ee4bd-a95a-4160-9ca6-6833cbd3fce7 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:51.686071 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ee4bd-a95a-4160-9ca6-6833cbd3fce7 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:51.688151 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ee4bd-a95a-4160-9ca6-6833cbd3fce7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:51.701073 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ee4bd-a95a-4160-9ca6-6833cbd3fce7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:26:51.706599 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-4a5ee4bd-a95a-4160-9ca6-6833cbd3fce7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 12:26:51.706599 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:26:51.706599 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:26:51.706599 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:26:51.706599 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:26:51.706599 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:26:51.706599 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:26:51.706599 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:26:51.706599 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:26:51.706599 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:26:51.706599 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:26:51.706599 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:26:51.706599 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:26:51.706599 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:26:51.706599 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:26:51.706599 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:26:51.707504 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:26:51.707504 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:26:51.707504 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:26:51.707504 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:26:51.707504 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:26:51.707504 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:26:51.707504 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:26:51.707504 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:26:51.707504 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:26:51.707504 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:26:51.707504 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:26:51.707504 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:26:51.707504 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:26:51.707504 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:26:51.707504 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:26:51.707504 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:26:51.708271 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:26:51.708271 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:26:51.708271 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:26:51.708271 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:26:51.708271 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:26:51.708271 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:26:51.708271 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:26:51.708271 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:26:51.708271 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:26:51.708271 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:26:51.708271 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 12:26:51.708271 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:26:51.712731 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 65/126] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:26:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:26:51.713553 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ee4bd-a95a-4160-9ca6-6833cbd3fce7 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:51.732685 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dcbfea-6675-417f-b7d0-6c4384bf42f2 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:51.768303 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd4762-e5de-4664-8dcc-87503069101c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:51.768957 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd4762-e5de-4664-8dcc-87503069101c None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:51.769280 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd4762-e5de-4664-8dcc-87503069101c None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:51.769565 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd4762-e5de-4664-8dcc-87503069101c None admin] PATH_INFO: `/v3/domains/default` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:51.770792 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd4762-e5de-4664-8dcc-87503069101c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:51.772262 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd4762-e5de-4664-8dcc-87503069101c None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:51.778324 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 62/127] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:26:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:51.778324 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd4762-e5de-4664-8dcc-87503069101c None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:51.789425 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:51.827029 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ee4bd-a95a-4160-9ca6-6833cbd3fce7 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:51.863359 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae185b2-c235-45ae-8790-5fb5110c7e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:51.864087 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae185b2-c235-45ae-8790-5fb5110c7e48 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:51.864464 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae185b2-c235-45ae-8790-5fb5110c7e48 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:51.864755 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae185b2-c235-45ae-8790-5fb5110c7e48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:51.875935 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:51.881392 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd4762-e5de-4664-8dcc-87503069101c None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:51.917060 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59d777-d74d-4e88-b435-cb322f97dddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:51.917768 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59d777-d74d-4e88-b435-cb322f97dddf None admin] REQUEST_METHOD: `PUT` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:51.918058 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59d777-d74d-4e88-b435-cb322f97dddf None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:51.918342 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59d777-d74d-4e88-b435-cb322f97dddf None admin] PATH_INFO: `/v3/projects/66779a17edc9443c8c1afeca9d6f3b11/users/4af0ab4ee85144758573e3303fe9cf81/roles/28c0b3a6358343c398e7df818529a952` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:51.920583 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f59d777-d74d-4e88-b435-cb322f97dddf None admin] RBAC: Authorizing `identity:create_grant(project_id=66779a17edc9443c8c1afeca9d6f3b11, user_id=4af0ab4ee85144758573e3303fe9cf81, role_id=28c0b3a6358343c398e7df818529a952)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:51.922087 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f59d777-d74d-4e88-b435-cb322f97dddf None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:51.938294 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 63/128] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jul 27 12:26:51 2022] PUT /identity/v3/projects/66779a17edc9443c8c1afeca9d6f3b11/users/4af0ab4ee85144758573e3303fe9cf81/roles/28c0b3a6358343c398e7df818529a952 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 12:26:51.938903 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59d777-d74d-4e88-b435-cb322f97dddf None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:51.948491 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae185b2-c235-45ae-8790-5fb5110c7e48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:51.951605 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae185b2-c235-45ae-8790-5fb5110c7e48 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:52.023884 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:52.076970 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59d777-d74d-4e88-b435-cb322f97dddf None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:52.110287 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 66/129] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jul 27 12:26:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 12:26:52.111258 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae185b2-c235-45ae-8790-5fb5110c7e48 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:52.127545 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec10d6-ec4f-4c84-9827-9521929f0163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:52.128225 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec10d6-ec4f-4c84-9827-9521929f0163 None admin] REQUEST_METHOD: `PUT` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:52.128514 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec10d6-ec4f-4c84-9827-9521929f0163 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:52.128795 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec10d6-ec4f-4c84-9827-9521929f0163 None admin] PATH_INFO: `/v3/projects/66779a17edc9443c8c1afeca9d6f3b11/users/4af0ab4ee85144758573e3303fe9cf81/roles/2136377433854360927c578b39f16e6f` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:52.130829 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec10d6-ec4f-4c84-9827-9521929f0163 None admin] RBAC: Authorizing `identity:create_grant(project_id=66779a17edc9443c8c1afeca9d6f3b11, user_id=4af0ab4ee85144758573e3303fe9cf81, role_id=2136377433854360927c578b39f16e6f)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:52.132280 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec10d6-ec4f-4c84-9827-9521929f0163 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:52.152284 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 64/130] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jul 27 12:26:51 2022] PUT /identity/v3/projects/66779a17edc9443c8c1afeca9d6f3b11/users/4af0ab4ee85144758573e3303fe9cf81/roles/2136377433854360927c578b39f16e6f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 12:26:52.152284 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec10d6-ec4f-4c84-9827-9521929f0163 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:52.179291 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:52.261945 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae185b2-c235-45ae-8790-5fb5110c7e48 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:52.290740 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec10d6-ec4f-4c84-9827-9521929f0163 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:52.299794 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce10af-36ba-4d37-9a5f-d94b2cc07753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:52.300521 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce10af-36ba-4d37-9a5f-d94b2cc07753 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:52.300875 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce10af-36ba-4d37-9a5f-d94b2cc07753 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:52.301324 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce10af-36ba-4d37-9a5f-d94b2cc07753 None admin] PATH_INFO: `/v3/roles` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:52.302342 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ce10af-36ba-4d37-9a5f-d94b2cc07753 None admin] RBAC: Adding query filter params (name=member) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:26:52.302717 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ce10af-36ba-4d37-9a5f-d94b2cc07753 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:52.304437 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ce10af-36ba-4d37-9a5f-d94b2cc07753 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:52.313398 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 67/131] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jul 27 12:26:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:52.318332 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce10af-36ba-4d37-9a5f-d94b2cc07753 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:52.326852 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:52.334221 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb8be3-b1d7-4a1d-aa07-4b661e34ed25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:52.335245 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb8be3-b1d7-4a1d-aa07-4b661e34ed25 None admin] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:52.336056 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb8be3-b1d7-4a1d-aa07-4b661e34ed25 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:52.336892 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb8be3-b1d7-4a1d-aa07-4b661e34ed25 None admin] PATH_INFO: `/v3/projects` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:52.338019 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb8be3-b1d7-4a1d-aa07-4b661e34ed25 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:52.339691 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb8be3-b1d7-4a1d-aa07-4b661e34ed25 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:52.380534 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 65/132] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jul 27 12:26:52 2022] POST /identity/v3/projects => generated 302 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 12:26:52.381808 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb8be3-b1d7-4a1d-aa07-4b661e34ed25 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:52.463479 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce10af-36ba-4d37-9a5f-d94b2cc07753 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:52.465954 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:52.509152 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d950e-0855-486a-b4ea-de16476843b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:52.509873 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d950e-0855-486a-b4ea-de16476843b1 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:52.510169 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d950e-0855-486a-b4ea-de16476843b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:52.510465 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d950e-0855-486a-b4ea-de16476843b1 None admin] PATH_INFO: `/v3/projects/66779a17edc9443c8c1afeca9d6f3b11` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:52.511979 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d950e-0855-486a-b4ea-de16476843b1 None admin] RBAC: Authorizing `identity:get_project(project_id=66779a17edc9443c8c1afeca9d6f3b11)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:52.513678 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d950e-0855-486a-b4ea-de16476843b1 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:52.515883 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 68/133] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jul 27 12:26:52 2022] GET /identity/v3/projects/66779a17edc9443c8c1afeca9d6f3b11 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:52.522702 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d950e-0855-486a-b4ea-de16476843b1 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:52.641977 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d950e-0855-486a-b4ea-de16476843b1 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:52.673946 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb8be3-b1d7-4a1d-aa07-4b661e34ed25 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:52.715788 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d1543-e984-45df-b269-0ce6ec633502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:52.716825 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d1543-e984-45df-b269-0ce6ec633502 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:52.717160 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d1543-e984-45df-b269-0ce6ec633502 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:52.717393 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d1543-e984-45df-b269-0ce6ec633502 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:52.719123 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d1543-e984-45df-b269-0ce6ec633502 None admin] RBAC: Adding query filter params (role.id=dc674f0d3e424f7baef5700ad3f7ff65, scope.project.id=66779a17edc9443c8c1afeca9d6f3b11, user.id=b9f646e5981e416d99cb32ee7727ef22) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:26:52.719445 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d1543-e984-45df-b269-0ce6ec633502 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:52.721423 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d1543-e984-45df-b269-0ce6ec633502 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:52.734827 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 69/134] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jul 27 12:26:52 2022] GET /identity/v3/role_assignments?user.id=b9f646e5981e416d99cb32ee7727ef22&scope.project.id=66779a17edc9443c8c1afeca9d6f3b11&role.id=dc674f0d3e424f7baef5700ad3f7ff65 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:26:52.739047 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d76e6-4afc-421c-b953-d631bff9592b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:52.739733 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d76e6-4afc-421c-b953-d631bff9592b None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:52.740020 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d76e6-4afc-421c-b953-d631bff9592b None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:52.740560 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d76e6-4afc-421c-b953-d631bff9592b None admin] PATH_INFO: `/v3/users/4af0ab4ee85144758573e3303fe9cf81` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:52.742026 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d76e6-4afc-421c-b953-d631bff9592b None admin] RBAC: Authorizing `identity:get_user(user_id=4af0ab4ee85144758573e3303fe9cf81)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:52.743552 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d76e6-4afc-421c-b953-d631bff9592b None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:52.745427 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 66/135] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jul 27 12:26:52 2022] GET /identity/v3/users/4af0ab4ee85144758573e3303fe9cf81 => generated 275 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:52.751411 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d1543-e984-45df-b269-0ce6ec633502 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:52.817416 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:52.870718 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d1543-e984-45df-b269-0ce6ec633502 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:52.919491 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8770eb-969c-440a-a804-357120468292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:52.920104 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8770eb-969c-440a-a804-357120468292 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:52.920394 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8770eb-969c-440a-a804-357120468292 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:52.920678 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8770eb-969c-440a-a804-357120468292 None admin] PATH_INFO: `/v3/projects/c264bf60c6da40cbb53c275c5ca014fd` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:52.921953 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8770eb-969c-440a-a804-357120468292 None admin] RBAC: Authorizing `identity:get_project(project_id=c264bf60c6da40cbb53c275c5ca014fd)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:52.923467 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8770eb-969c-440a-a804-357120468292 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:52.925780 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 70/136] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jul 27 12:26:52 2022] GET /identity/v3/projects/c264bf60c6da40cbb53c275c5ca014fd => generated 312 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:52.933835 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d76e6-4afc-421c-b953-d631bff9592b None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:53.019511 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:53.087077 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d76e6-4afc-421c-b953-d631bff9592b None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:53.134388 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eee96b-e8e6-4b22-b041-ef1d981215b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:53.135075 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eee96b-e8e6-4b22-b041-ef1d981215b1 None admin] REQUEST_METHOD: `PUT` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:53.135360 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eee96b-e8e6-4b22-b041-ef1d981215b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:53.135644 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eee96b-e8e6-4b22-b041-ef1d981215b1 None admin] PATH_INFO: `/v3/projects/c264bf60c6da40cbb53c275c5ca014fd/users/4af0ab4ee85144758573e3303fe9cf81/roles/2136377433854360927c578b39f16e6f` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:53.138981 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eee96b-e8e6-4b22-b041-ef1d981215b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=c264bf60c6da40cbb53c275c5ca014fd, user_id=4af0ab4ee85144758573e3303fe9cf81, role_id=2136377433854360927c578b39f16e6f)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:53.140670 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eee96b-e8e6-4b22-b041-ef1d981215b1 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:53.156923 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 67/137] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jul 27 12:26:52 2022] PUT /identity/v3/projects/c264bf60c6da40cbb53c275c5ca014fd/users/4af0ab4ee85144758573e3303fe9cf81/roles/2136377433854360927c578b39f16e6f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 12:26:53.187001 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2972be5-07ff-4378-ad5d-fcf7f73b6348 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:53.187289 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2972be5-07ff-4378-ad5d-fcf7f73b6348 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:53.187493 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2972be5-07ff-4378-ad5d-fcf7f73b6348 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:53.188909 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 71/138] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:26:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:26:53.195251 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1824afd-2478-4e1d-9875-3ec27421e034 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:53.195561 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1824afd-2478-4e1d-9875-3ec27421e034 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:53.195826 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1824afd-2478-4e1d-9875-3ec27421e034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:53.223834 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-f1824afd-2478-4e1d-9875-3ec27421e034 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:26:53.225031 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-f1824afd-2478-4e1d-9875-3ec27421e034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:26:53.320239 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 68/139] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:26:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:26:53.367162 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2972be5-07ff-4378-ad5d-fcf7f73b6348 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:53.508349 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2972be5-07ff-4378-ad5d-fcf7f73b6348 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:53.510769 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:53.558895 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33815da4-3e64-4fe1-9098-202fc5b7222e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:53.559668 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33815da4-3e64-4fe1-9098-202fc5b7222e None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:53.560023 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33815da4-3e64-4fe1-9098-202fc5b7222e None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:53.560315 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33815da4-3e64-4fe1-9098-202fc5b7222e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:53.578601 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33815da4-3e64-4fe1-9098-202fc5b7222e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:26:53.584255 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-33815da4-3e64-4fe1-9098-202fc5b7222e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 12:26:53.584255 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:26:53.584255 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:26:53.584255 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:26:53.584255 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:26:53.584255 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:26:53.584255 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:26:53.584255 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:26:53.584255 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:26:53.584255 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:26:53.584255 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:26:53.584255 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:26:53.584255 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:26:53.584255 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:26:53.584255 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:26:53.584255 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:26:53.585129 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:26:53.585129 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:26:53.585129 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:26:53.585129 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:26:53.585129 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:26:53.585129 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:26:53.585129 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:26:53.585129 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:26:53.585129 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:26:53.585129 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:26:53.585129 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:26:53.585129 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:26:53.585129 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:26:53.585129 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:26:53.585129 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:26:53.585129 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:26:53.585947 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:26:53.585947 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:26:53.585947 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:26:53.585947 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:26:53.585947 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:26:53.585947 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:26:53.585947 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:26:53.585947 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:26:53.585947 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:26:53.585947 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:26:53.585947 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 12:26:53.585947 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:26:53.585947 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 72/140] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jul 27 12:26:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:26:53.594748 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1824afd-2478-4e1d-9875-3ec27421e034 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:53.657966 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:53.738285 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1824afd-2478-4e1d-9875-3ec27421e034 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:53.786409 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6c44d-8df6-4749-a0c3-6e04cb38f63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:53.787235 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6c44d-8df6-4749-a0c3-6e04cb38f63b None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:53.787524 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6c44d-8df6-4749-a0c3-6e04cb38f63b None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:53.787803 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6c44d-8df6-4749-a0c3-6e04cb38f63b None admin] PATH_INFO: `/v3/roles` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:53.788537 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6c44d-8df6-4749-a0c3-6e04cb38f63b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:26:53.788847 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6c44d-8df6-4749-a0c3-6e04cb38f63b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:53.790257 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6c44d-8df6-4749-a0c3-6e04cb38f63b None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:53.805869 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 69/141] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:26:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:53.811543 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33815da4-3e64-4fe1-9098-202fc5b7222e None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:53.947440 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33815da4-3e64-4fe1-9098-202fc5b7222e None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:53.993754 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8439f8f6-7ec5-4705-8c40-50d90549de7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:53.994421 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439f8f6-7ec5-4705-8c40-50d90549de7d None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:53.994708 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439f8f6-7ec5-4705-8c40-50d90549de7d None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:53.994994 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439f8f6-7ec5-4705-8c40-50d90549de7d None admin] PATH_INFO: `/v3/users/39c655ecdea3454d98a7abe23dc966e9` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:53.996219 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8439f8f6-7ec5-4705-8c40-50d90549de7d None admin] RBAC: Authorizing `identity:get_user(user_id=39c655ecdea3454d98a7abe23dc966e9)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:53.997701 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8439f8f6-7ec5-4705-8c40-50d90549de7d None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:53.999628 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 73/142] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jul 27 12:26:53 2022] GET /identity/v3/users/39c655ecdea3454d98a7abe23dc966e9 => generated 247 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:54.004905 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6c44d-8df6-4749-a0c3-6e04cb38f63b None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:54.138798 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6c44d-8df6-4749-a0c3-6e04cb38f63b None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:54.142716 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:54.182472 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0956f71-ccd9-4b51-bbfa-c9e361fb8b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:54.183104 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0956f71-ccd9-4b51-bbfa-c9e361fb8b16 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:54.183383 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0956f71-ccd9-4b51-bbfa-c9e361fb8b16 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:54.183658 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0956f71-ccd9-4b51-bbfa-c9e361fb8b16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:54.266992 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0956f71-ccd9-4b51-bbfa-c9e361fb8b16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:54.268487 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0956f71-ccd9-4b51-bbfa-c9e361fb8b16 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:54.373420 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 70/143] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jul 27 12:26:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 12:26:54.379163 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8439f8f6-7ec5-4705-8c40-50d90549de7d None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:54.432485 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:54.522713 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8439f8f6-7ec5-4705-8c40-50d90549de7d None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:54.570563 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d485d84-9673-4c9a-836c-62d1ef98bd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:54.571283 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d485d84-9673-4c9a-836c-62d1ef98bd06 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:54.571581 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d485d84-9673-4c9a-836c-62d1ef98bd06 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:54.571878 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d485d84-9673-4c9a-836c-62d1ef98bd06 None admin] PATH_INFO: `/v3/projects/66779a17edc9443c8c1afeca9d6f3b11` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:54.573091 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d485d84-9673-4c9a-836c-62d1ef98bd06 None admin] RBAC: Authorizing `identity:get_project(project_id=66779a17edc9443c8c1afeca9d6f3b11)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:54.574577 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d485d84-9673-4c9a-836c-62d1ef98bd06 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:54.576700 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 74/144] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jul 27 12:26:54 2022] GET /identity/v3/projects/66779a17edc9443c8c1afeca9d6f3b11 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:54.583032 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0956f71-ccd9-4b51-bbfa-c9e361fb8b16 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:54.587928 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:54.744046 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0956f71-ccd9-4b51-bbfa-c9e361fb8b16 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:54.787171 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24ac5a-eeed-4b8d-9829-fa4b2c1b95b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:54.788170 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24ac5a-eeed-4b8d-9829-fa4b2c1b95b3 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:54.788646 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24ac5a-eeed-4b8d-9829-fa4b2c1b95b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:54.789120 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24ac5a-eeed-4b8d-9829-fa4b2c1b95b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:54.790123 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24ac5a-eeed-4b8d-9829-fa4b2c1b95b3 None admin] RBAC: Adding query filter params (role.id=af00ed97066e4c72aeb6cd3d5b5d15c9, scope.project.id=66779a17edc9443c8c1afeca9d6f3b11, user.id=39c655ecdea3454d98a7abe23dc966e9) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:26:54.790647 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24ac5a-eeed-4b8d-9829-fa4b2c1b95b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:54.792269 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24ac5a-eeed-4b8d-9829-fa4b2c1b95b3 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:54.802653 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 71/145] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jul 27 12:26:54 2022] GET /identity/v3/role_assignments?user.id=39c655ecdea3454d98a7abe23dc966e9&scope.project.id=66779a17edc9443c8c1afeca9d6f3b11&role.id=af00ed97066e4c72aeb6cd3d5b5d15c9 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:55.182439 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d7648-2a1a-410f-a1e1-59c2c260dd4f None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:55.182795 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d7648-2a1a-410f-a1e1-59c2c260dd4f None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:55.183010 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d7648-2a1a-410f-a1e1-59c2c260dd4f None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:55.184581 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 75/146] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:26:55.190351 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f33da-c765-42da-a6f7-e96f617b0a6e None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:55.190868 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f33da-c765-42da-a6f7-e96f617b0a6e None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:55.191357 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f33da-c765-42da-a6f7-e96f617b0a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:55.212901 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-e09f33da-c765-42da-a6f7-e96f617b0a6e None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:26:55.214403 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-e09f33da-c765-42da-a6f7-e96f617b0a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:26:55.291329 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:55.297956 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 72/147] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:26:55.351346 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d7648-2a1a-410f-a1e1-59c2c260dd4f None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:55.471360 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:55.476370 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d7648-2a1a-410f-a1e1-59c2c260dd4f None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:55.523906 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5a536-e656-4a56-be73-4cdc31de1aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:55.524639 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5a536-e656-4a56-be73-4cdc31de1aa1 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:55.524909 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5a536-e656-4a56-be73-4cdc31de1aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:55.525192 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5a536-e656-4a56-be73-4cdc31de1aa1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:55.536893 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c5a536-e656-4a56-be73-4cdc31de1aa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:26:55.541971 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-d1c5a536-e656-4a56-be73-4cdc31de1aa1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 12:26:55.541971 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:26:55.541971 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:26:55.541971 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:26:55.541971 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:26:55.541971 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:26:55.541971 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:26:55.541971 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:26:55.541971 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:26:55.541971 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:26:55.541971 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:26:55.541971 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:26:55.541971 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:26:55.541971 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:26:55.541971 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:26:55.541971 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:26:55.542827 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:26:55.542827 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:26:55.542827 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:26:55.542827 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:26:55.542827 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:26:55.542827 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:26:55.542827 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:26:55.542827 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:26:55.542827 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:26:55.542827 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:26:55.542827 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:26:55.542827 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:26:55.542827 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:26:55.542827 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:26:55.542827 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:26:55.542827 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:26:55.543963 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:26:55.543963 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:26:55.543963 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:26:55.543963 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:26:55.543963 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:26:55.543963 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:26:55.543963 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:26:55.543963 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:26:55.543963 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:26:55.543963 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:26:55.543963 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 12:26:55.543963 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:26:55.543963 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 76/148] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jul 27 12:26:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:26:55.550908 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f33da-c765-42da-a6f7-e96f617b0a6e None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:55.708554 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f33da-c765-42da-a6f7-e96f617b0a6e None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:55.763364 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496eb74f-8541-4b4d-aac8-667d1b456e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:55.764741 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496eb74f-8541-4b4d-aac8-667d1b456e94 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:55.765223 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496eb74f-8541-4b4d-aac8-667d1b456e94 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:55.765713 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496eb74f-8541-4b4d-aac8-667d1b456e94 None admin] PATH_INFO: `/v3/roles` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:55.766647 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496eb74f-8541-4b4d-aac8-667d1b456e94 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:26:55.767140 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496eb74f-8541-4b4d-aac8-667d1b456e94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:55.769341 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496eb74f-8541-4b4d-aac8-667d1b456e94 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:55.781056 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 73/149] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jul 27 12:26:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:55.786792 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5a536-e656-4a56-be73-4cdc31de1aa1 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:55.936265 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5a536-e656-4a56-be73-4cdc31de1aa1 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:55.959617 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0ecb4-1f5c-466a-bc7a-a2e76d35f78c None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:55.960283 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0ecb4-1f5c-466a-bc7a-a2e76d35f78c None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:55.960758 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0ecb4-1f5c-466a-bc7a-a2e76d35f78c None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:55.962466 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 74/150] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:26:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 12:26:55.968616 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5856676-608e-453e-901a-9581a1d6a5e2 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:55.969194 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5856676-608e-453e-901a-9581a1d6a5e2 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:55.969705 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5856676-608e-453e-901a-9581a1d6a5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:55.988550 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-d5856676-608e-453e-901a-9581a1d6a5e2 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:26:55.990096 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-d5856676-608e-453e-901a-9581a1d6a5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:26:55.992919 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb04a39-2714-4351-90d0-499dd2c5310f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:55.993570 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb04a39-2714-4351-90d0-499dd2c5310f None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:55.994589 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb04a39-2714-4351-90d0-499dd2c5310f None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:55.994589 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb04a39-2714-4351-90d0-499dd2c5310f None admin] PATH_INFO: `/v3/users/4af0ab4ee85144758573e3303fe9cf81` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:55.998318 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb04a39-2714-4351-90d0-499dd2c5310f None admin] RBAC: Authorizing `identity:get_user(user_id=4af0ab4ee85144758573e3303fe9cf81)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:55.999755 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb04a39-2714-4351-90d0-499dd2c5310f None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:56.001384 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 77/151] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jul 27 12:26:55 2022] GET /identity/v3/users/4af0ab4ee85144758573e3303fe9cf81 => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:56.007192 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb04a39-2714-4351-90d0-499dd2c5310f None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:56.066032 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:56.066359 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:56.105549 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 75/152] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 12:26:56.113869 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fec079-9334-498f-8bff-89f0262f20fa None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:56.114404 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fec079-9334-498f-8bff-89f0262f20fa None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:56.114828 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fec079-9334-498f-8bff-89f0262f20fa None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:56.116580 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 76/153] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:26:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 12:26:56.121835 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9b508-65b9-4d33-a708-934f54a9f929 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:56.122286 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9b508-65b9-4d33-a708-934f54a9f929 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:56.122738 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9b508-65b9-4d33-a708-934f54a9f929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:56.141230 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-30b9b508-65b9-4d33-a708-934f54a9f929 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:26:56.143284 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-30b9b508-65b9-4d33-a708-934f54a9f929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:26:56.169407 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb04a39-2714-4351-90d0-499dd2c5310f None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:56.208097 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18c95e-7d14-4063-9e5d-f49cb1ee927c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:56.208720 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18c95e-7d14-4063-9e5d-f49cb1ee927c None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:56.209002 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18c95e-7d14-4063-9e5d-f49cb1ee927c None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:56.209277 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18c95e-7d14-4063-9e5d-f49cb1ee927c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:56.214698 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 77/154] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:26:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 12:26:56.216252 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1b19d-be4b-4da7-bed9-fa52721d4985 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:56.216544 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1b19d-be4b-4da7-bed9-fa52721d4985 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:56.216824 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1b19d-be4b-4da7-bed9-fa52721d4985 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:56.222360 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 78/155] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:26:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:26:56.223140 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1b19d-be4b-4da7-bed9-fa52721d4985 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:56.291625 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de18c95e-7d14-4063-9e5d-f49cb1ee927c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:56.293299 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de18c95e-7d14-4063-9e5d-f49cb1ee927c None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:56.323687 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:56.339647 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1b19d-be4b-4da7-bed9-fa52721d4985 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:56.367415 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:56.381052 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffcd496-ed84-4716-a56e-250bf17bf90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:56.381731 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcd496-ed84-4716-a56e-250bf17bf90d None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:56.382019 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcd496-ed84-4716-a56e-250bf17bf90d None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:56.382323 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffcd496-ed84-4716-a56e-250bf17bf90d None admin] PATH_INFO: `/v3/roles/member` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:56.392718 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffcd496-ed84-4716-a56e-250bf17bf90d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:26:56.397736 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-7ffcd496-ed84-4716-a56e-250bf17bf90d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 12:26:56.397736 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:26:56.397736 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:26:56.397736 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:26:56.397736 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:26:56.397736 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:26:56.397736 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:26:56.397736 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:26:56.397736 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:26:56.397736 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:26:56.397736 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:26:56.397736 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:26:56.397736 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:26:56.397736 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:26:56.397736 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:26:56.397736 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:26:56.398780 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:26:56.398780 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:26:56.398780 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:26:56.398780 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:26:56.398780 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:26:56.398780 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:26:56.398780 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:26:56.398780 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:26:56.398780 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:26:56.398780 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:26:56.398780 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:26:56.398780 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:26:56.398780 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:26:56.398780 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:26:56.398780 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:26:56.398780 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:26:56.399623 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:26:56.399623 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:26:56.399623 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:26:56.399623 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:26:56.399623 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:26:56.399623 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:26:56.399623 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:26:56.399623 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:26:56.399623 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:26:56.399623 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:26:56.399623 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 12:26:56.399623 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:26:56.399623 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 79/156] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:26:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:26:56.400876 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19091048-55bb-4ef1-9d77-4d6dd3d91ed1 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:56.400876 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19091048-55bb-4ef1-9d77-4d6dd3d91ed1 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:56.401154 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19091048-55bb-4ef1-9d77-4d6dd3d91ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:56.414377 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 78/157] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jul 27 12:26:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 12:26:56.416076 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18c95e-7d14-4063-9e5d-f49cb1ee927c None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:56.419538 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-19091048-55bb-4ef1-9d77-4d6dd3d91ed1 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:26:56.420856 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-19091048-55bb-4ef1-9d77-4d6dd3d91ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:26:56.498420 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 80/158] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:26:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:26:56.499428 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19091048-55bb-4ef1-9d77-4d6dd3d91ed1 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:56.536914 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18c95e-7d14-4063-9e5d-f49cb1ee927c None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:56.564183 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:56.573757 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd20b0-6a49-460a-8ef0-452ff82ff893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:56.574435 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd20b0-6a49-460a-8ef0-452ff82ff893 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:56.574722 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd20b0-6a49-460a-8ef0-452ff82ff893 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:56.574999 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd20b0-6a49-460a-8ef0-452ff82ff893 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:56.585846 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd20b0-6a49-460a-8ef0-452ff82ff893 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:26:56.591533 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-3ddd20b0-6a49-460a-8ef0-452ff82ff893 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 12:26:56.591533 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:26:56.591533 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:26:56.591533 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:26:56.591533 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:26:56.591533 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:26:56.591533 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:26:56.591533 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:26:56.591533 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:26:56.591533 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:26:56.591533 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:26:56.591533 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:26:56.591533 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:26:56.591533 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:26:56.591533 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:26:56.591533 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:26:56.592399 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:26:56.592399 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:26:56.592399 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:26:56.592399 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:26:56.592399 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:26:56.592399 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:26:56.592399 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:26:56.592399 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:26:56.592399 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:26:56.592399 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:26:56.592399 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:26:56.592399 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:26:56.592399 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:26:56.592399 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:26:56.592399 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:26:56.592399 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:26:56.593247 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:26:56.593247 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:26:56.593247 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:26:56.593247 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:26:56.593247 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:26:56.593247 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:26:56.593247 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:26:56.593247 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:26:56.593247 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:26:56.593247 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:26:56.593247 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 12:26:56.593247 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:26:56.593247 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 79/159] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:26:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:26:56.593945 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd20b0-6a49-460a-8ef0-452ff82ff893 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:56.620307 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19091048-55bb-4ef1-9d77-4d6dd3d91ed1 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:56.633283 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:56.660295 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706eefd-8eee-4d29-8690-13bd589f832a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:56.660927 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706eefd-8eee-4d29-8690-13bd589f832a None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:56.661233 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706eefd-8eee-4d29-8690-13bd589f832a None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:56.661487 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706eefd-8eee-4d29-8690-13bd589f832a None admin] PATH_INFO: `/v3/roles` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:56.662275 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f706eefd-8eee-4d29-8690-13bd589f832a None admin] RBAC: Adding query filter params (name=member) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:26:56.662587 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f706eefd-8eee-4d29-8690-13bd589f832a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:56.664764 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f706eefd-8eee-4d29-8690-13bd589f832a None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:56.676849 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 81/160] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jul 27 12:26:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:56.681573 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706eefd-8eee-4d29-8690-13bd589f832a None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:56.719514 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd20b0-6a49-460a-8ef0-452ff82ff893 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:56.755515 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942987f-421a-4671-b340-bc94a46d7df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:56.756293 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942987f-421a-4671-b340-bc94a46d7df9 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:56.756645 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942987f-421a-4671-b340-bc94a46d7df9 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:56.756997 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942987f-421a-4671-b340-bc94a46d7df9 None admin] PATH_INFO: `/v3/projects/66779a17edc9443c8c1afeca9d6f3b11` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:56.758231 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5942987f-421a-4671-b340-bc94a46d7df9 None admin] RBAC: Authorizing `identity:get_project(project_id=66779a17edc9443c8c1afeca9d6f3b11)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:56.759684 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5942987f-421a-4671-b340-bc94a46d7df9 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:56.761459 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 80/161] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jul 27 12:26:56 2022] GET /identity/v3/projects/66779a17edc9443c8c1afeca9d6f3b11 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:56.765500 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942987f-421a-4671-b340-bc94a46d7df9 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:56.791506 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706eefd-8eee-4d29-8690-13bd589f832a None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:56.822463 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:56.827868 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6348af4-da7e-40fa-91d4-f0a582c49746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:56.828459 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6348af4-da7e-40fa-91d4-f0a582c49746 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:56.828743 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6348af4-da7e-40fa-91d4-f0a582c49746 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:56.829020 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6348af4-da7e-40fa-91d4-f0a582c49746 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:56.830730 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6348af4-da7e-40fa-91d4-f0a582c49746 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:56.832204 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6348af4-da7e-40fa-91d4-f0a582c49746 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:56.833847 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 82/162] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:26:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:56.838470 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6348af4-da7e-40fa-91d4-f0a582c49746 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:56.874695 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942987f-421a-4671-b340-bc94a46d7df9 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:56.880402 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:56.907113 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df00e1-64e7-4317-9b35-7c3a2ffc008a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:56.907728 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df00e1-64e7-4317-9b35-7c3a2ffc008a None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:56.908006 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df00e1-64e7-4317-9b35-7c3a2ffc008a None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:56.908944 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df00e1-64e7-4317-9b35-7c3a2ffc008a None admin] PATH_INFO: `/v3/roles` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:56.909682 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41df00e1-64e7-4317-9b35-7c3a2ffc008a None admin] RBAC: Adding query filter params (name=reader) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:26:56.909987 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41df00e1-64e7-4317-9b35-7c3a2ffc008a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:56.911359 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41df00e1-64e7-4317-9b35-7c3a2ffc008a None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:56.919469 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 81/163] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jul 27 12:26:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:56.921221 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb3881-f2f1-4622-b72e-35db86521653 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:56.921511 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb3881-f2f1-4622-b72e-35db86521653 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:56.921900 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb3881-f2f1-4622-b72e-35db86521653 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:56.923276 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 82/164] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:26:56.926776 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb3881-f2f1-4622-b72e-35db86521653 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:56.937870 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6348af4-da7e-40fa-91d4-f0a582c49746 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:56.971383 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4519215-ba3f-4dbd-8a85-1fde72cdec32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:56.972013 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4519215-ba3f-4dbd-8a85-1fde72cdec32 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:56.972297 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4519215-ba3f-4dbd-8a85-1fde72cdec32 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:56.972573 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4519215-ba3f-4dbd-8a85-1fde72cdec32 None admin] PATH_INFO: `/v3/users/4af0ab4ee85144758573e3303fe9cf81` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:56.973733 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4519215-ba3f-4dbd-8a85-1fde72cdec32 None admin] RBAC: Authorizing `identity:get_user(user_id=4af0ab4ee85144758573e3303fe9cf81)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:56.975159 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4519215-ba3f-4dbd-8a85-1fde72cdec32 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:56.976735 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 83/165] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jul 27 12:26:56 2022] GET /identity/v3/users/4af0ab4ee85144758573e3303fe9cf81 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:56.977475 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4519215-ba3f-4dbd-8a85-1fde72cdec32 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:57.029323 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb3881-f2f1-4622-b72e-35db86521653 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:57.045694 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:57.065237 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738d2e4-9383-447b-9f49-99a306f3e7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:57.065866 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738d2e4-9383-447b-9f49-99a306f3e7df None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:57.066147 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738d2e4-9383-447b-9f49-99a306f3e7df None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:57.066416 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738d2e4-9383-447b-9f49-99a306f3e7df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:57.067232 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4738d2e4-9383-447b-9f49-99a306f3e7df None admin] RBAC: Adding query filter params (role.id=28c0b3a6358343c398e7df818529a952, scope.project.id=66779a17edc9443c8c1afeca9d6f3b11, user.id=4af0ab4ee85144758573e3303fe9cf81) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:26:57.067537 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4738d2e4-9383-447b-9f49-99a306f3e7df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:57.068958 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4738d2e4-9383-447b-9f49-99a306f3e7df None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:57.072878 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4519215-ba3f-4dbd-8a85-1fde72cdec32 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:57.074580 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 83/166] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jul 27 12:26:56 2022] GET /identity/v3/role_assignments?user.id=4af0ab4ee85144758573e3303fe9cf81&scope.project.id=66779a17edc9443c8c1afeca9d6f3b11&role.id=28c0b3a6358343c398e7df818529a952 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:57.075347 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738d2e4-9383-447b-9f49-99a306f3e7df None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:57.089865 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:57.117670 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db6374-a357-492e-92b3-76042777f0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:57.118324 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db6374-a357-492e-92b3-76042777f0b1 None admin] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:57.118608 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db6374-a357-492e-92b3-76042777f0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:57.118886 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db6374-a357-492e-92b3-76042777f0b1 None admin] PATH_INFO: `/v3/users` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:57.119584 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db6374-a357-492e-92b3-76042777f0b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:57.121048 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db6374-a357-492e-92b3-76042777f0b1 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:57.147249 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 84/167] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jul 27 12:26:56 2022] POST /identity/v3/users => generated 283 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 12:26:57.148593 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ef687-e5aa-491e-ad55-2a46d599ef1c None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:57.148885 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ef687-e5aa-491e-ad55-2a46d599ef1c None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:57.149247 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ef687-e5aa-491e-ad55-2a46d599ef1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:57.181381 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-b35ef687-e5aa-491e-ad55-2a46d599ef1c None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:26:57.183510 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-b35ef687-e5aa-491e-ad55-2a46d599ef1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:26:57.229075 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738d2e4-9383-447b-9f49-99a306f3e7df None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:57.272791 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02baf893-7274-40cb-96f0-900ca8571f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:57.273456 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02baf893-7274-40cb-96f0-900ca8571f77 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:57.273812 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02baf893-7274-40cb-96f0-900ca8571f77 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:57.274093 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02baf893-7274-40cb-96f0-900ca8571f77 None admin] PATH_INFO: `/v3/users/b9f646e5981e416d99cb32ee7727ef22` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:57.275518 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02baf893-7274-40cb-96f0-900ca8571f77 None admin] RBAC: Authorizing `identity:get_user(user_id=b9f646e5981e416d99cb32ee7727ef22)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:57.276835 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 85/168] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:26:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:26:57.277630 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ef687-e5aa-491e-ad55-2a46d599ef1c None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:57.282016 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02baf893-7274-40cb-96f0-900ca8571f77 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:57.287173 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 84/169] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jul 27 12:26:57 2022] GET /identity/v3/users/b9f646e5981e416d99cb32ee7727ef22 => generated 289 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:57.292995 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02baf893-7274-40cb-96f0-900ca8571f77 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:57.360719 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:57.411881 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:57.419276 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ef687-e5aa-491e-ad55-2a46d599ef1c None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:57.431162 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02baf893-7274-40cb-96f0-900ca8571f77 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:57.461443 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c336f-0c36-472b-8a0a-cf2ca81d57da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:57.462121 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c336f-0c36-472b-8a0a-cf2ca81d57da None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:57.462407 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c336f-0c36-472b-8a0a-cf2ca81d57da None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:57.463005 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c336f-0c36-472b-8a0a-cf2ca81d57da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:57.472371 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144733c2-6c37-414d-a5c2-66f73d80d429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:57.473030 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144733c2-6c37-414d-a5c2-66f73d80d429 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:57.473354 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144733c2-6c37-414d-a5c2-66f73d80d429 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:57.473706 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144733c2-6c37-414d-a5c2-66f73d80d429 None admin] PATH_INFO: `/v3/projects/66779a17edc9443c8c1afeca9d6f3b11` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:57.474879 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144733c2-6c37-414d-a5c2-66f73d80d429 None admin] RBAC: Authorizing `identity:get_project(project_id=66779a17edc9443c8c1afeca9d6f3b11)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:57.476337 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144733c2-6c37-414d-a5c2-66f73d80d429 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:57.478084 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 85/170] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jul 27 12:26:57 2022] GET /identity/v3/projects/66779a17edc9443c8c1afeca9d6f3b11 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:26:57.478858 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144733c2-6c37-414d-a5c2-66f73d80d429 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:57.547429 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c336f-0c36-472b-8a0a-cf2ca81d57da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:57.549559 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c336f-0c36-472b-8a0a-cf2ca81d57da None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:57.603257 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144733c2-6c37-414d-a5c2-66f73d80d429 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:57.628221 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:57.648855 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ae857-41ac-439c-8a40-0e3b5090783b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:57.649516 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ae857-41ac-439c-8a40-0e3b5090783b None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:57.649841 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ae857-41ac-439c-8a40-0e3b5090783b None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:57.650124 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ae857-41ac-439c-8a40-0e3b5090783b None admin] PATH_INFO: `/v3/roles/member` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:57.662548 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ae857-41ac-439c-8a40-0e3b5090783b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:26:57.668557 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-3e9ae857-41ac-439c-8a40-0e3b5090783b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 12:26:57.668557 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:26:57.668557 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:26:57.668557 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:26:57.668557 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:26:57.668557 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:26:57.668557 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:26:57.668557 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:26:57.668557 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:26:57.668557 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:26:57.668557 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:26:57.668557 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:26:57.668557 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:26:57.668557 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:26:57.668557 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:26:57.668557 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:26:57.669491 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:26:57.669491 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:26:57.669491 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:26:57.669491 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:26:57.669491 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:26:57.669491 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:26:57.669491 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:26:57.669491 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:26:57.669491 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:26:57.669491 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:26:57.669491 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:26:57.669491 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:26:57.669491 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:26:57.669491 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:26:57.669491 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:26:57.669491 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:26:57.670375 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:26:57.670375 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:26:57.670375 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:26:57.670375 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:26:57.670375 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:26:57.670375 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:26:57.670375 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:26:57.670375 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:26:57.670375 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:26:57.670375 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:26:57.670375 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 12:26:57.670375 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:26:57.670375 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 86/171] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:26:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:26:57.671043 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ae857-41ac-439c-8a40-0e3b5090783b None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:57.679530 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:57.690873 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 86/172] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jul 27 12:26:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 12:26:57.692495 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c336f-0c36-472b-8a0a-cf2ca81d57da None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:57.790932 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ae857-41ac-439c-8a40-0e3b5090783b None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:57.812271 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c336f-0c36-472b-8a0a-cf2ca81d57da None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:57.827287 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084cf75-50ff-49b1-8ffd-3f7ed488c4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:57.828252 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084cf75-50ff-49b1-8ffd-3f7ed488c4df None admin] REQUEST_METHOD: `PUT` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:57.828714 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084cf75-50ff-49b1-8ffd-3f7ed488c4df None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:57.829265 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084cf75-50ff-49b1-8ffd-3f7ed488c4df None admin] PATH_INFO: `/v3/projects/66779a17edc9443c8c1afeca9d6f3b11/users/b9f646e5981e416d99cb32ee7727ef22/roles/dc674f0d3e424f7baef5700ad3f7ff65` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:57.831719 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084cf75-50ff-49b1-8ffd-3f7ed488c4df None admin] RBAC: Authorizing `identity:create_grant(project_id=66779a17edc9443c8c1afeca9d6f3b11, user_id=b9f646e5981e416d99cb32ee7727ef22, role_id=dc674f0d3e424f7baef5700ad3f7ff65)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:57.833353 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084cf75-50ff-49b1-8ffd-3f7ed488c4df None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:57.850368 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 87/173] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jul 27 12:26:57 2022] PUT /identity/v3/projects/66779a17edc9443c8c1afeca9d6f3b11/users/b9f646e5981e416d99cb32ee7727ef22/roles/dc674f0d3e424f7baef5700ad3f7ff65 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 12:26:57.851815 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084cf75-50ff-49b1-8ffd-3f7ed488c4df None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:57.858481 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c0454-3cff-44fa-be4d-b4f4eb6a3977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:57.860063 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c0454-3cff-44fa-be4d-b4f4eb6a3977 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:57.860063 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c0454-3cff-44fa-be4d-b4f4eb6a3977 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:57.860063 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c0454-3cff-44fa-be4d-b4f4eb6a3977 None admin] PATH_INFO: `/v3/roles` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:57.860654 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c0454-3cff-44fa-be4d-b4f4eb6a3977 None admin] RBAC: Adding query filter params (name=member) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:26:57.860957 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c0454-3cff-44fa-be4d-b4f4eb6a3977 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:57.863210 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c0454-3cff-44fa-be4d-b4f4eb6a3977 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:57.876331 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 87/174] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jul 27 12:26:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:57.882235 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c0454-3cff-44fa-be4d-b4f4eb6a3977 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:57.905191 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:57.956203 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:57.999983 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084cf75-50ff-49b1-8ffd-3f7ed488c4df None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:58.017220 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c0454-3cff-44fa-be4d-b4f4eb6a3977 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:58.042351 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85cb0ee-73fb-420a-8370-013e1235a629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:58.042950 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cb0ee-73fb-420a-8370-013e1235a629 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:58.043234 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cb0ee-73fb-420a-8370-013e1235a629 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:58.043506 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85cb0ee-73fb-420a-8370-013e1235a629 None admin] PATH_INFO: `/v3/projects/66779a17edc9443c8c1afeca9d6f3b11` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:58.044709 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85cb0ee-73fb-420a-8370-013e1235a629 None admin] RBAC: Authorizing `identity:get_project(project_id=66779a17edc9443c8c1afeca9d6f3b11)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:58.046752 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85cb0ee-73fb-420a-8370-013e1235a629 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:58.048498 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 88/175] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jul 27 12:26:57 2022] GET /identity/v3/projects/66779a17edc9443c8c1afeca9d6f3b11 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:58.057235 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85cb0ee-73fb-420a-8370-013e1235a629 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:58.077349 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cfe6d8-0e0a-4e11-a108-d56b28b04701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:58.078039 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cfe6d8-0e0a-4e11-a108-d56b28b04701 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:58.078320 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cfe6d8-0e0a-4e11-a108-d56b28b04701 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:58.078593 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cfe6d8-0e0a-4e11-a108-d56b28b04701 None admin] PATH_INFO: `/v3/users/4af0ab4ee85144758573e3303fe9cf81` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:58.079832 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cfe6d8-0e0a-4e11-a108-d56b28b04701 None admin] RBAC: Authorizing `identity:get_user(user_id=4af0ab4ee85144758573e3303fe9cf81)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:58.081579 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cfe6d8-0e0a-4e11-a108-d56b28b04701 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:58.083503 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 88/176] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jul 27 12:26:57 2022] GET /identity/v3/users/4af0ab4ee85144758573e3303fe9cf81 => generated 275 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:26:58.089312 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cfe6d8-0e0a-4e11-a108-d56b28b04701 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:58.212241 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cfe6d8-0e0a-4e11-a108-d56b28b04701 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:58.247869 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85cb0ee-73fb-420a-8370-013e1235a629 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:58.248058 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:58.252336 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:58.264029 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8697a33e-1922-4968-b45e-d6e10be6415f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:58.265238 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697a33e-1922-4968-b45e-d6e10be6415f None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:58.265523 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697a33e-1922-4968-b45e-d6e10be6415f None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:58.265834 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697a33e-1922-4968-b45e-d6e10be6415f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:58.345320 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8697a33e-1922-4968-b45e-d6e10be6415f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:58.347137 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8697a33e-1922-4968-b45e-d6e10be6415f None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:58.357234 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336ed1e-54e6-4197-b25b-32694743a633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:58.358205 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336ed1e-54e6-4197-b25b-32694743a633 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:58.358721 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336ed1e-54e6-4197-b25b-32694743a633 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:58.359197 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336ed1e-54e6-4197-b25b-32694743a633 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:58.360198 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336ed1e-54e6-4197-b25b-32694743a633 None admin] RBAC: Adding query filter params (role.id=2136377433854360927c578b39f16e6f, scope.project.id=66779a17edc9443c8c1afeca9d6f3b11, user.id=4af0ab4ee85144758573e3303fe9cf81) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:26:58.360710 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336ed1e-54e6-4197-b25b-32694743a633 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:58.362920 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336ed1e-54e6-4197-b25b-32694743a633 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:58.376655 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 89/177] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jul 27 12:26:58 2022] GET /identity/v3/role_assignments?user.id=4af0ab4ee85144758573e3303fe9cf81&scope.project.id=66779a17edc9443c8c1afeca9d6f3b11&role.id=2136377433854360927c578b39f16e6f => generated 608 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:58.456865 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 89/178] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jul 27 12:26:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 12:26:58.462717 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336ed1e-54e6-4197-b25b-32694743a633 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:58.575518 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336ed1e-54e6-4197-b25b-32694743a633 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:58.614334 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12fe185-18d2-410d-9684-8e5c790d91a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:58.615129 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fe185-18d2-410d-9684-8e5c790d91a1 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:58.615675 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fe185-18d2-410d-9684-8e5c790d91a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:58.615955 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fe185-18d2-410d-9684-8e5c790d91a1 None admin] PATH_INFO: `/v3/projects/c264bf60c6da40cbb53c275c5ca014fd` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:58.617154 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12fe185-18d2-410d-9684-8e5c790d91a1 None admin] RBAC: Authorizing `identity:get_project(project_id=c264bf60c6da40cbb53c275c5ca014fd)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:58.618616 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12fe185-18d2-410d-9684-8e5c790d91a1 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:58.624721 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 90/179] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jul 27 12:26:58 2022] GET /identity/v3/projects/c264bf60c6da40cbb53c275c5ca014fd => generated 312 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:26:58.626634 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8697a33e-1922-4968-b45e-d6e10be6415f None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:26:58.653327 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:26:58.734765 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8697a33e-1922-4968-b45e-d6e10be6415f None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:26:58.775532 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b5f80-c4f4-4b64-85b2-6d8918392b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:26:58.776171 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b5f80-c4f4-4b64-85b2-6d8918392b76 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:26:58.776432 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b5f80-c4f4-4b64-85b2-6d8918392b76 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:26:58.776711 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b5f80-c4f4-4b64-85b2-6d8918392b76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:26:58.777515 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b5f80-c4f4-4b64-85b2-6d8918392b76 None admin] RBAC: Adding query filter params (role.id=2136377433854360927c578b39f16e6f, scope.project.id=c264bf60c6da40cbb53c275c5ca014fd, user.id=4af0ab4ee85144758573e3303fe9cf81) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:26:58.777828 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b5f80-c4f4-4b64-85b2-6d8918392b76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:26:58.779295 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b5f80-c4f4-4b64-85b2-6d8918392b76 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:26:58.785946 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 90/180] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jul 27 12:26:58 2022] GET /identity/v3/role_assignments?user.id=4af0ab4ee85144758573e3303fe9cf81&scope.project.id=c264bf60c6da40cbb53c275c5ca014fd&role.id=2136377433854360927c578b39f16e6f => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:00.091390 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df63b3-6111-42d6-abe5-459ae4ad282b None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:00.092104 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df63b3-6111-42d6-abe5-459ae4ad282b None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:00.092104 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df63b3-6111-42d6-abe5-459ae4ad282b None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:00.093735 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 91/181] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:00.099895 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c09f86-5c00-4c9d-ac02-511ab414cd93 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:00.100529 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c09f86-5c00-4c9d-ac02-511ab414cd93 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:00.100529 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c09f86-5c00-4c9d-ac02-511ab414cd93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:00.120636 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-12c09f86-5c00-4c9d-ac02-511ab414cd93 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:00.121876 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-12c09f86-5c00-4c9d-ac02-511ab414cd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:00.193795 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 91/182] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:27:00.217447 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df63b3-6111-42d6-abe5-459ae4ad282b None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:00.248249 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb3442-1235-46d9-adae-bfd1fafb17e4 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:00.248549 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb3442-1235-46d9-adae-bfd1fafb17e4 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:00.248799 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb3442-1235-46d9-adae-bfd1fafb17e4 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:00.250648 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 92/183] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:00.260045 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e29a1c-abca-4e22-895b-a299b631b5ff None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:00.260330 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e29a1c-abca-4e22-895b-a299b631b5ff None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:00.260606 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e29a1c-abca-4e22-895b-a299b631b5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:00.267833 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:00.286489 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-32e29a1c-abca-4e22-895b-a299b631b5ff None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:00.287983 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-32e29a1c-abca-4e22-895b-a299b631b5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:00.307208 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:00.344504 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df63b3-6111-42d6-abe5-459ae4ad282b None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:00.368954 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 93/184] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:27:00.389957 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9b3db-e1b5-4e43-ab41-fc6222d9a91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:00.390930 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9b3db-e1b5-4e43-ab41-fc6222d9a91a None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:00.391405 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9b3db-e1b5-4e43-ab41-fc6222d9a91a None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:00.392016 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9b3db-e1b5-4e43-ab41-fc6222d9a91a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:00.393775 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e29a1c-abca-4e22-895b-a299b631b5ff None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:00.404862 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9b3db-e1b5-4e43-ab41-fc6222d9a91a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:00.410611 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-c8e9b3db-e1b5-4e43-ab41-fc6222d9a91a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 12:27:00.410611 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:00.410611 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:00.410611 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:00.410611 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:00.410611 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:00.410611 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:00.410611 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:00.410611 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:00.410611 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:00.410611 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:00.410611 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:00.410611 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:00.410611 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:00.410611 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:00.410611 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:00.411556 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:00.411556 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:00.411556 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:00.411556 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:00.411556 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:00.411556 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:00.411556 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:00.411556 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:00.411556 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:00.411556 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:00.411556 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:00.411556 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:00.411556 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:00.411556 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:00.411556 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:00.411556 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:00.412757 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:00.412757 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:00.412757 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:00.412757 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:00.412757 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:00.412757 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:00.412757 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:00.412757 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:00.412757 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:00.412757 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:00.412757 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 12:27:00.412757 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:00.412757 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 92/185] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jul 27 12:27:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:00.418006 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9b3db-e1b5-4e43-ab41-fc6222d9a91a None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:00.526086 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:00.533906 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9b3db-e1b5-4e43-ab41-fc6222d9a91a None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:00.540977 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e29a1c-abca-4e22-895b-a299b631b5ff None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:00.574971 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c0c74-9904-4b5b-9bdb-dfcbff5c85ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:00.575629 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c0c74-9904-4b5b-9bdb-dfcbff5c85ef None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:00.575924 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c0c74-9904-4b5b-9bdb-dfcbff5c85ef None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:00.576206 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c0c74-9904-4b5b-9bdb-dfcbff5c85ef None admin] PATH_INFO: `/v3/roles` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:00.577026 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c0c74-9904-4b5b-9bdb-dfcbff5c85ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:00.577414 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c0c74-9904-4b5b-9bdb-dfcbff5c85ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:00.579329 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c0c74-9904-4b5b-9bdb-dfcbff5c85ef None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:00.585216 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc14f7b-a59b-411e-974f-cb980278cb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:00.585895 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc14f7b-a59b-411e-974f-cb980278cb79 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:00.586323 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc14f7b-a59b-411e-974f-cb980278cb79 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:00.586602 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc14f7b-a59b-411e-974f-cb980278cb79 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:00.588425 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 93/186] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:27:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:27:00.589363 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240cd05-7916-4037-932d-06f0d752ae77 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:00.589786 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240cd05-7916-4037-932d-06f0d752ae77 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:00.590075 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240cd05-7916-4037-932d-06f0d752ae77 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:00.591291 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 94/187] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:00.599138 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc14f7b-a59b-411e-974f-cb980278cb79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:00.599282 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15333376-2c94-4579-8fe4-c23f52f656ad None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:00.599466 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15333376-2c94-4579-8fe4-c23f52f656ad None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:00.599743 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15333376-2c94-4579-8fe4-c23f52f656ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:00.604402 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-edc14f7b-a59b-411e-974f-cb980278cb79 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 12:27:00.604402 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:00.604402 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:00.604402 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:00.604402 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:00.604402 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:00.604402 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:00.604402 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:00.604402 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:00.604402 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:00.604402 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:00.604402 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:00.604402 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:00.604402 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:00.604402 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:00.604402 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:00.606559 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:00.606559 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:00.606559 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:00.606559 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:00.606559 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:00.606559 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:00.606559 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:00.606559 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:00.606559 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:00.606559 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:00.606559 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:00.606559 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:00.606559 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:00.606559 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:00.606559 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:00.606559 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:00.608746 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:00.608746 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:00.608746 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:00.608746 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:00.608746 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:00.608746 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:00.608746 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:00.608746 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:00.608746 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:00.608746 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:00.608746 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 12:27:00.608746 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:00.608746 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 94/188] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jul 27 12:27:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 12:27:00.608746 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc14f7b-a59b-411e-974f-cb980278cb79 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:00.620056 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:00.623392 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-15333376-2c94-4579-8fe4-c23f52f656ad None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:00.624662 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-15333376-2c94-4579-8fe4-c23f52f656ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:00.699549 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 95/189] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:27:00.705803 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15333376-2c94-4579-8fe4-c23f52f656ad None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:00.717613 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc14f7b-a59b-411e-974f-cb980278cb79 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:00.752873 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907fe160-f3e9-4209-b2bf-893c59199de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:00.753517 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907fe160-f3e9-4209-b2bf-893c59199de3 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:00.753829 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907fe160-f3e9-4209-b2bf-893c59199de3 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:00.754107 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907fe160-f3e9-4209-b2bf-893c59199de3 None admin] PATH_INFO: `/v3/users/c765a25ada7147fcacec33b3858eb218` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:00.766807 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907fe160-f3e9-4209-b2bf-893c59199de3 None admin] RBAC: Authorizing `identity:get_user(user_id=c765a25ada7147fcacec33b3858eb218)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:00.768823 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907fe160-f3e9-4209-b2bf-893c59199de3 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:00.770599 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 95/190] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jul 27 12:27:00 2022] GET /identity/v3/users/c765a25ada7147fcacec33b3858eb218 => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:00.771747 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61d75a-a78e-406c-b611-a2fc451ddc17 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:00.772032 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61d75a-a78e-406c-b611-a2fc451ddc17 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:00.772310 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61d75a-a78e-406c-b611-a2fc451ddc17 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:00.773525 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 96/191] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:00.778143 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61d75a-a78e-406c-b611-a2fc451ddc17 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:00.798229 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:00.810634 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15333376-2c94-4579-8fe4-c23f52f656ad None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:00.846890 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:00.847413 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cac199-c59e-4224-bcd1-9175992d97d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:00.848127 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cac199-c59e-4224-bcd1-9175992d97d5 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:00.848415 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cac199-c59e-4224-bcd1-9175992d97d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:00.848760 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cac199-c59e-4224-bcd1-9175992d97d5 None admin] PATH_INFO: `/v3/roles` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:00.849581 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cac199-c59e-4224-bcd1-9175992d97d5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:00.849856 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cac199-c59e-4224-bcd1-9175992d97d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:00.851251 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cac199-c59e-4224-bcd1-9175992d97d5 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:00.859127 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 96/192] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jul 27 12:27:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:00.859933 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cac199-c59e-4224-bcd1-9175992d97d5 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:00.883326 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61d75a-a78e-406c-b611-a2fc451ddc17 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:00.916974 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142db38-31de-4157-9be4-ec99bf714c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:00.917648 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142db38-31de-4157-9be4-ec99bf714c22 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:00.917918 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142db38-31de-4157-9be4-ec99bf714c22 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:00.918196 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142db38-31de-4157-9be4-ec99bf714c22 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:00.919334 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c142db38-31de-4157-9be4-ec99bf714c22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:00.920800 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c142db38-31de-4157-9be4-ec99bf714c22 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:00.925687 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 97/193] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:27:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:00.925687 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5eab7-dd21-4c37-ab04-8da1de42595d None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:00.925687 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5eab7-dd21-4c37-ab04-8da1de42595d None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:00.925687 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5eab7-dd21-4c37-ab04-8da1de42595d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:00.942455 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-f3c5eab7-dd21-4c37-ab04-8da1de42595d None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:00.943698 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-f3c5eab7-dd21-4c37-ab04-8da1de42595d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:00.961058 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cac199-c59e-4224-bcd1-9175992d97d5 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:00.993529 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f5c3e-69f7-4af8-8168-a7b9c6dfd29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:00.994169 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f5c3e-69f7-4af8-8168-a7b9c6dfd29c None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:00.994457 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f5c3e-69f7-4af8-8168-a7b9c6dfd29c None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:00.994733 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f5c3e-69f7-4af8-8168-a7b9c6dfd29c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:01.012026 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 98/194] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:27:01.018649 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c5eab7-dd21-4c37-ab04-8da1de42595d None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:01.018742 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:01.064049 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f5c3e-69f7-4af8-8168-a7b9c6dfd29c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:01.066171 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f5c3e-69f7-4af8-8168-a7b9c6dfd29c None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:01.079960 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:01.117583 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c5eab7-dd21-4c37-ab04-8da1de42595d None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:01.150685 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07911414-2adf-4de4-9a8f-f9bbbc054784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:01.151324 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07911414-2adf-4de4-9a8f-f9bbbc054784 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:01.151609 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07911414-2adf-4de4-9a8f-f9bbbc054784 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:01.151884 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07911414-2adf-4de4-9a8f-f9bbbc054784 None admin] PATH_INFO: `/v3/users/c765a25ada7147fcacec33b3858eb218` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:01.153046 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07911414-2adf-4de4-9a8f-f9bbbc054784 None admin] RBAC: Authorizing `identity:get_user(user_id=c765a25ada7147fcacec33b3858eb218)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:01.154551 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07911414-2adf-4de4-9a8f-f9bbbc054784 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:01.156146 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 99/195] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jul 27 12:27:01 2022] GET /identity/v3/users/c765a25ada7147fcacec33b3858eb218 => generated 283 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:01.156893 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07911414-2adf-4de4-9a8f-f9bbbc054784 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:01.163054 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 97/196] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jul 27 12:27:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 12:27:01.164759 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f5c3e-69f7-4af8-8168-a7b9c6dfd29c None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:01.214171 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:01.259546 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07911414-2adf-4de4-9a8f-f9bbbc054784 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:01.267146 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f5c3e-69f7-4af8-8168-a7b9c6dfd29c None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:01.288793 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:01.294496 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e680e377-791d-42f7-9cb4-ad4a8e991cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:01.295116 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680e377-791d-42f7-9cb4-ad4a8e991cc9 None admin] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:01.295402 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680e377-791d-42f7-9cb4-ad4a8e991cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:01.295679 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e680e377-791d-42f7-9cb4-ad4a8e991cc9 None admin] PATH_INFO: `/v3/users` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:01.296363 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e680e377-791d-42f7-9cb4-ad4a8e991cc9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:01.297855 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e680e377-791d-42f7-9cb4-ad4a8e991cc9 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:01.300829 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aea6f45-3fa1-4deb-a3c2-3f3a087e055c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:01.301467 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea6f45-3fa1-4deb-a3c2-3f3a087e055c None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:01.301785 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea6f45-3fa1-4deb-a3c2-3f3a087e055c None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:01.302066 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea6f45-3fa1-4deb-a3c2-3f3a087e055c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:01.312250 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aea6f45-3fa1-4deb-a3c2-3f3a087e055c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:01.317936 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-0aea6f45-3fa1-4deb-a3c2-3f3a087e055c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 12:27:01.317936 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:01.317936 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:01.317936 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:01.317936 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:01.317936 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:01.317936 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:01.317936 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:01.317936 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:01.317936 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:01.317936 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:01.317936 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:01.317936 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:01.317936 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:01.317936 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:01.317936 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:01.319006 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:01.319006 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:01.319006 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:01.319006 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:01.319006 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:01.319006 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:01.319006 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:01.319006 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:01.319006 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:01.319006 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:01.319006 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:01.319006 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:01.319006 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:01.319006 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:01.319006 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:01.319006 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:01.320002 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:01.320002 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:01.320002 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:01.320002 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:01.320002 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:01.320002 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:01.320002 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:01.320002 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:01.320002 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:01.320002 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:01.320002 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 12:27:01.320002 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:01.320718 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 100/197] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jul 27 12:27:01 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 12:27:01.320788 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 98/198] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:27:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:01.320788 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aea6f45-3fa1-4deb-a3c2-3f3a087e055c None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:01.322603 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e680e377-791d-42f7-9cb4-ad4a8e991cc9 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:01.443115 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aea6f45-3fa1-4deb-a3c2-3f3a087e055c None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:01.447037 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e680e377-791d-42f7-9cb4-ad4a8e991cc9 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:01.456008 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:01.484074 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431cc74f-3102-497a-bf64-b7c406ed1c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:01.484738 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cc74f-3102-497a-bf64-b7c406ed1c1b None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:01.485018 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cc74f-3102-497a-bf64-b7c406ed1c1b None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:01.485117 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cec7cc-2c23-4e01-9a06-6b11750b509d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:01.485295 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cc74f-3102-497a-bf64-b7c406ed1c1b None admin] PATH_INFO: `/v3/projects/252e28aa3a004a2c871b20abe82e81ee` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:01.485676 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cec7cc-2c23-4e01-9a06-6b11750b509d None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:01.485964 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cec7cc-2c23-4e01-9a06-6b11750b509d None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:01.486312 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cec7cc-2c23-4e01-9a06-6b11750b509d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:01.487578 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431cc74f-3102-497a-bf64-b7c406ed1c1b None admin] RBAC: Authorizing `identity:get_project(project_id=252e28aa3a004a2c871b20abe82e81ee)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:01.489291 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431cc74f-3102-497a-bf64-b7c406ed1c1b None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:01.492175 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 99/199] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jul 27 12:27:01 2022] GET /identity/v3/projects/252e28aa3a004a2c871b20abe82e81ee => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:01.492961 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431cc74f-3102-497a-bf64-b7c406ed1c1b None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:01.557321 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:01.574482 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cec7cc-2c23-4e01-9a06-6b11750b509d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:01.575900 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cec7cc-2c23-4e01-9a06-6b11750b509d None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:01.620786 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431cc74f-3102-497a-bf64-b7c406ed1c1b None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:01.667229 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d7249-f70b-4b1b-90c5-f02dbe83fd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:01.668106 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d7249-f70b-4b1b-90c5-f02dbe83fd35 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:01.669012 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d7249-f70b-4b1b-90c5-f02dbe83fd35 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:01.669445 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d7249-f70b-4b1b-90c5-f02dbe83fd35 None admin] PATH_INFO: `/v3/roles` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:01.670352 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d7249-f70b-4b1b-90c5-f02dbe83fd35 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:01.671216 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d7249-f70b-4b1b-90c5-f02dbe83fd35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:01.673762 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d7249-f70b-4b1b-90c5-f02dbe83fd35 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:01.682873 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 100/200] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jul 27 12:27:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:01.683713 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d7249-f70b-4b1b-90c5-f02dbe83fd35 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:01.707180 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 101/201] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jul 27 12:27:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 12:27:01.712442 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cec7cc-2c23-4e01-9a06-6b11750b509d None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:01.745949 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:01.811956 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cec7cc-2c23-4e01-9a06-6b11750b509d None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:01.812912 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d7249-f70b-4b1b-90c5-f02dbe83fd35 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:01.846020 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:01.847906 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3610a3-ac25-4940-931a-7b433ed9c347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:01.848564 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3610a3-ac25-4940-931a-7b433ed9c347 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:01.848738 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8a666-01f5-425f-9f62-7cb11146b404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:01.848846 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3610a3-ac25-4940-931a-7b433ed9c347 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:01.849113 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3610a3-ac25-4940-931a-7b433ed9c347 None admin] PATH_INFO: `/v3/users/b9f646e5981e416d99cb32ee7727ef22` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:01.849385 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8a666-01f5-425f-9f62-7cb11146b404 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:01.849855 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8a666-01f5-425f-9f62-7cb11146b404 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:01.850137 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8a666-01f5-425f-9f62-7cb11146b404 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:01.850418 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3610a3-ac25-4940-931a-7b433ed9c347 None admin] RBAC: Authorizing `identity:get_user(user_id=b9f646e5981e416d99cb32ee7727ef22)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:01.850950 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8a666-01f5-425f-9f62-7cb11146b404 None admin] RBAC: Adding query filter params (role.id=af00ed97066e4c72aeb6cd3d5b5d15c9, scope.project.id=252e28aa3a004a2c871b20abe82e81ee, user.id=c765a25ada7147fcacec33b3858eb218) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:01.851264 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8a666-01f5-425f-9f62-7cb11146b404 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:01.851957 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3610a3-ac25-4940-931a-7b433ed9c347 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:01.852675 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8a666-01f5-425f-9f62-7cb11146b404 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:01.853581 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 102/202] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jul 27 12:27:01 2022] GET /identity/v3/users/b9f646e5981e416d99cb32ee7727ef22 => generated 289 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:01.854515 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3610a3-ac25-4940-931a-7b433ed9c347 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:01.865204 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 101/203] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jul 27 12:27:01 2022] GET /identity/v3/role_assignments?user.id=c765a25ada7147fcacec33b3858eb218&scope.project.id=252e28aa3a004a2c871b20abe82e81ee&role.id=af00ed97066e4c72aeb6cd3d5b5d15c9 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:01.866454 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8a666-01f5-425f-9f62-7cb11146b404 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:02.015935 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3610a3-ac25-4940-931a-7b433ed9c347 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:02.054016 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e601ea8-be38-484d-b01a-35d96ec3b71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:02.054685 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e601ea8-be38-484d-b01a-35d96ec3b71d None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:02.054970 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e601ea8-be38-484d-b01a-35d96ec3b71d None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:02.055250 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e601ea8-be38-484d-b01a-35d96ec3b71d None admin] PATH_INFO: `/v3/projects/252e28aa3a004a2c871b20abe82e81ee` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:02.056453 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e601ea8-be38-484d-b01a-35d96ec3b71d None admin] RBAC: Authorizing `identity:get_project(project_id=252e28aa3a004a2c871b20abe82e81ee)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:02.057958 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e601ea8-be38-484d-b01a-35d96ec3b71d None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:02.059839 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 103/204] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jul 27 12:27:01 2022] GET /identity/v3/projects/252e28aa3a004a2c871b20abe82e81ee => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:02.066673 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e601ea8-be38-484d-b01a-35d96ec3b71d None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:02.069759 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8a666-01f5-425f-9f62-7cb11146b404 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:02.086671 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:02.095324 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:02.133414 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043686de-f1ad-4615-b680-5d39a576aa16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:02.134499 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043686de-f1ad-4615-b680-5d39a576aa16 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:02.135009 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043686de-f1ad-4615-b680-5d39a576aa16 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:02.135489 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043686de-f1ad-4615-b680-5d39a576aa16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:02.188067 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e601ea8-be38-484d-b01a-35d96ec3b71d None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:02.224071 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ecfe61-5bd4-4c96-b823-fb157b217114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:02.224685 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecfe61-5bd4-4c96-b823-fb157b217114 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:02.224969 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecfe61-5bd4-4c96-b823-fb157b217114 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:02.225244 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecfe61-5bd4-4c96-b823-fb157b217114 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:02.226078 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ecfe61-5bd4-4c96-b823-fb157b217114 None admin] RBAC: Adding query filter params (role.id=28c0b3a6358343c398e7df818529a952, scope.project.id=252e28aa3a004a2c871b20abe82e81ee, user.id=c765a25ada7147fcacec33b3858eb218) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:02.226390 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ecfe61-5bd4-4c96-b823-fb157b217114 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:02.228006 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ecfe61-5bd4-4c96-b823-fb157b217114 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:02.240551 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 104/205] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jul 27 12:27:02 2022] GET /identity/v3/role_assignments?user.id=c765a25ada7147fcacec33b3858eb218&scope.project.id=252e28aa3a004a2c871b20abe82e81ee&role.id=28c0b3a6358343c398e7df818529a952 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:02.288357 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043686de-f1ad-4615-b680-5d39a576aa16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:02.289928 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043686de-f1ad-4615-b680-5d39a576aa16 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:02.437630 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 102/206] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jul 27 12:27:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 12:27:02.446063 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ecfe61-5bd4-4c96-b823-fb157b217114 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:02.612186 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:02.635707 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ecfe61-5bd4-4c96-b823-fb157b217114 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:02.693941 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154318f-388d-446f-900f-229e62901c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:02.694609 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154318f-388d-446f-900f-229e62901c0a None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:02.694893 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154318f-388d-446f-900f-229e62901c0a None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:02.695174 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154318f-388d-446f-900f-229e62901c0a None admin] PATH_INFO: `/v3/projects/66779a17edc9443c8c1afeca9d6f3b11` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:02.702331 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0154318f-388d-446f-900f-229e62901c0a None admin] RBAC: Authorizing `identity:get_project(project_id=66779a17edc9443c8c1afeca9d6f3b11)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:02.703804 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0154318f-388d-446f-900f-229e62901c0a None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:02.705755 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 105/207] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jul 27 12:27:02 2022] GET /identity/v3/projects/66779a17edc9443c8c1afeca9d6f3b11 => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:02.711585 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043686de-f1ad-4615-b680-5d39a576aa16 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:02.718619 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:02.858152 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043686de-f1ad-4615-b680-5d39a576aa16 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:02.912611 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c77c3e-2cbd-4aaa-a103-05d84c005678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:02.913126 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c77c3e-2cbd-4aaa-a103-05d84c005678 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:02.913407 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c77c3e-2cbd-4aaa-a103-05d84c005678 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:02.913702 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c77c3e-2cbd-4aaa-a103-05d84c005678 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:02.914499 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c77c3e-2cbd-4aaa-a103-05d84c005678 None admin] RBAC: Adding query filter params (role.id=dc674f0d3e424f7baef5700ad3f7ff65, scope.project.id=66779a17edc9443c8c1afeca9d6f3b11, user.id=b9f646e5981e416d99cb32ee7727ef22) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:02.914809 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c77c3e-2cbd-4aaa-a103-05d84c005678 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:02.916381 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c77c3e-2cbd-4aaa-a103-05d84c005678 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:02.927024 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 103/208] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jul 27 12:27:02 2022] GET /identity/v3/role_assignments?user.id=b9f646e5981e416d99cb32ee7727ef22&scope.project.id=66779a17edc9443c8c1afeca9d6f3b11&role.id=dc674f0d3e424f7baef5700ad3f7ff65 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:03.969527 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04620f2-0582-438d-898f-612d377fad7a None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:03.970581 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04620f2-0582-438d-898f-612d377fad7a None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:03.971074 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04620f2-0582-438d-898f-612d377fad7a None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:03.972656 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 106/209] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:03.977937 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56085a0c-b7ae-45c3-a600-65832f07c564 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:03.978734 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56085a0c-b7ae-45c3-a600-65832f07c564 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:03.979219 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56085a0c-b7ae-45c3-a600-65832f07c564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:03.998353 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-56085a0c-b7ae-45c3-a600-65832f07c564 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:03.999893 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-56085a0c-b7ae-45c3-a600-65832f07c564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:04.047673 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff4a43-3311-4e90-b221-5d113b7954f7 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:04.048279 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff4a43-3311-4e90-b221-5d113b7954f7 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:04.049287 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff4a43-3311-4e90-b221-5d113b7954f7 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:04.051111 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 107/210] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 12:27:04.056200 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ce96e-e442-4d7a-89b2-9a4c03d017ae None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:04.056808 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ce96e-e442-4d7a-89b2-9a4c03d017ae None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:04.057281 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ce96e-e442-4d7a-89b2-9a4c03d017ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:04.066008 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:04.074848 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 104/211] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:27:04.081926 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-330ce96e-e442-4d7a-89b2-9a4c03d017ae None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:04.083361 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-330ce96e-e442-4d7a-89b2-9a4c03d017ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:04.106645 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56085a0c-b7ae-45c3-a600-65832f07c564 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:04.165912 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 108/212] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 12:27:04.192043 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ce96e-e442-4d7a-89b2-9a4c03d017ae None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:04.230740 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56085a0c-b7ae-45c3-a600-65832f07c564 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:04.270710 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821bc940-476c-432c-9218-5e3211fa1d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:04.271761 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821bc940-476c-432c-9218-5e3211fa1d65 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:04.272445 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821bc940-476c-432c-9218-5e3211fa1d65 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:04.272878 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821bc940-476c-432c-9218-5e3211fa1d65 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:04.282352 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:04.287781 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821bc940-476c-432c-9218-5e3211fa1d65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:04.293298 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-821bc940-476c-432c-9218-5e3211fa1d65 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 12:27:04.293298 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:04.293298 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:04.293298 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:04.293298 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:04.293298 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:04.293298 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:04.293298 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:04.293298 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:04.293298 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:04.293298 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:04.293298 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:04.293298 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:04.293298 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:04.293298 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:04.293298 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:04.294329 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:04.294329 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:04.294329 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:04.294329 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:04.294329 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:04.294329 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:04.294329 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:04.294329 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:04.294329 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:04.294329 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:04.294329 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:04.294329 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:04.294329 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:04.294329 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:04.294329 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:04.294329 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:04.295590 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:04.295590 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:04.295590 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:04.295590 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:04.295590 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:04.295590 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:04.295590 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:04.295590 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:04.295590 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:04.295590 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:04.295590 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 12:27:04.295590 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:04.303447 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ce96e-e442-4d7a-89b2-9a4c03d017ae None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:04.303702 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 105/213] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:27:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:04.304862 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821bc940-476c-432c-9218-5e3211fa1d65 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:04.336210 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0963832a-6bb1-47df-9586-9e4b15f58228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:04.336954 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963832a-6bb1-47df-9586-9e4b15f58228 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:04.337303 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963832a-6bb1-47df-9586-9e4b15f58228 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:04.337690 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963832a-6bb1-47df-9586-9e4b15f58228 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:04.338921 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0963832a-6bb1-47df-9586-9e4b15f58228 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:04.340440 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0963832a-6bb1-47df-9586-9e4b15f58228 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:04.346871 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 109/214] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:27:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:04.347759 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0963832a-6bb1-47df-9586-9e4b15f58228 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:04.372331 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:04.430370 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821bc940-476c-432c-9218-5e3211fa1d65 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:04.458055 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0963832a-6bb1-47df-9586-9e4b15f58228 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:04.472604 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156b06a-a998-43ed-84cd-a2e826191160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:04.473638 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156b06a-a998-43ed-84cd-a2e826191160 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:04.474120 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156b06a-a998-43ed-84cd-a2e826191160 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:04.474655 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156b06a-a998-43ed-84cd-a2e826191160 None admin] PATH_INFO: `/v3/roles` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:04.475553 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2156b06a-a998-43ed-84cd-a2e826191160 None admin] RBAC: Adding query filter params (name=member) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:04.476037 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2156b06a-a998-43ed-84cd-a2e826191160 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:04.477818 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2156b06a-a998-43ed-84cd-a2e826191160 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:04.488318 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 106/215] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jul 27 12:27:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:04.494411 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156b06a-a998-43ed-84cd-a2e826191160 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:04.497683 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91749e87-36c6-4693-9f0d-230bebf447a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:04.498158 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91749e87-36c6-4693-9f0d-230bebf447a2 None admin] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:04.498442 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91749e87-36c6-4693-9f0d-230bebf447a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:04.498766 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91749e87-36c6-4693-9f0d-230bebf447a2 None admin] PATH_INFO: `/v3/users` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:04.500182 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91749e87-36c6-4693-9f0d-230bebf447a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:04.501006 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91749e87-36c6-4693-9f0d-230bebf447a2 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:04.524441 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 110/216] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jul 27 12:27:04 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 12:27:04.592298 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf6ddf-067c-4a18-8793-e5f2c23e573b None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:04.592623 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf6ddf-067c-4a18-8793-e5f2c23e573b None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:04.592857 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf6ddf-067c-4a18-8793-e5f2c23e573b None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:04.594574 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 111/217] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 12:27:04.602218 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125ccfd-4217-4482-8634-6f5dc0192af9 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:04.602880 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125ccfd-4217-4482-8634-6f5dc0192af9 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:04.603812 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125ccfd-4217-4482-8634-6f5dc0192af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:04.623586 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156b06a-a998-43ed-84cd-a2e826191160 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:04.629935 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-1125ccfd-4217-4482-8634-6f5dc0192af9 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:04.631630 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-1125ccfd-4217-4482-8634-6f5dc0192af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:04.652529 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:04.658872 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:04.682338 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be670d5-8c9c-4a2f-b68b-0889352d1ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:04.683059 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be670d5-8c9c-4a2f-b68b-0889352d1ce3 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:04.683352 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be670d5-8c9c-4a2f-b68b-0889352d1ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:04.683665 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be670d5-8c9c-4a2f-b68b-0889352d1ce3 None admin] PATH_INFO: `/v3/users/65ae624a1b9042f4912ac9313fb85cf3` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:04.704748 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be670d5-8c9c-4a2f-b68b-0889352d1ce3 None admin] RBAC: Authorizing `identity:get_user(user_id=65ae624a1b9042f4912ac9313fb85cf3)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:04.706605 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be670d5-8c9c-4a2f-b68b-0889352d1ce3 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:04.708957 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 107/218] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jul 27 12:27:04 2022] GET /identity/v3/users/65ae624a1b9042f4912ac9313fb85cf3 => generated 297 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:27:04.714709 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be670d5-8c9c-4a2f-b68b-0889352d1ce3 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:04.745037 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 112/219] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 12:27:04.770568 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125ccfd-4217-4482-8634-6f5dc0192af9 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:04.840344 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be670d5-8c9c-4a2f-b68b-0889352d1ce3 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:04.884384 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a5a92-b667-4b98-a70d-1e080781535d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:04.885985 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a5a92-b667-4b98-a70d-1e080781535d None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:04.886452 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a5a92-b667-4b98-a70d-1e080781535d None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:04.886905 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a5a92-b667-4b98-a70d-1e080781535d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:04.895257 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125ccfd-4217-4482-8634-6f5dc0192af9 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:04.936490 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686259a3-ca40-4bcd-b570-c3823e4ffaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:04.937147 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686259a3-ca40-4bcd-b570-c3823e4ffaee None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:04.937429 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686259a3-ca40-4bcd-b570-c3823e4ffaee None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:04.937746 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686259a3-ca40-4bcd-b570-c3823e4ffaee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:04.944350 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:04.950071 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:04.958544 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686259a3-ca40-4bcd-b570-c3823e4ffaee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:04.964358 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-686259a3-ca40-4bcd-b570-c3823e4ffaee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 12:27:04.964358 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:04.964358 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:04.964358 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:04.964358 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:04.964358 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:04.964358 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:04.964358 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:04.964358 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:04.964358 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:04.964358 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:04.964358 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:04.964358 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:04.964358 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:04.964358 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:04.964358 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:04.965232 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:04.965232 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:04.965232 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:04.965232 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:04.965232 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:04.965232 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:04.965232 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:04.965232 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:04.965232 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:04.965232 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:04.965232 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:04.965232 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:04.965232 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:04.965232 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:04.965232 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:04.965232 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:04.970997 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:04.970997 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:04.970997 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:04.970997 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:04.970997 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:04.970997 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:04.970997 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:04.970997 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:04.970997 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:04.970997 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:04.970997 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 12:27:04.970997 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:04.970997 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 113/220] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jul 27 12:27:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:04.970997 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70efb48-5456-424b-b8f3-2248f7fceb89 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:04.972192 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70efb48-5456-424b-b8f3-2248f7fceb89 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:04.972192 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70efb48-5456-424b-b8f3-2248f7fceb89 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:04.972192 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 114/221] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:04.972192 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70efb48-5456-424b-b8f3-2248f7fceb89 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:04.985286 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a5a92-b667-4b98-a70d-1e080781535d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:04.988046 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a5a92-b667-4b98-a70d-1e080781535d None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:05.084260 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70efb48-5456-424b-b8f3-2248f7fceb89 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:05.104303 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 108/222] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jul 27 12:27:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 12:27:05.105969 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d2816-22cf-485e-b9e0-1aad372a518d None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:05.106461 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d2816-22cf-485e-b9e0-1aad372a518d None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:05.107013 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d2816-22cf-485e-b9e0-1aad372a518d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:05.126004 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-434d2816-22cf-485e-b9e0-1aad372a518d None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:05.128141 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-434d2816-22cf-485e-b9e0-1aad372a518d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:05.128421 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a7113-fc10-4122-b0c8-733f6d65a004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:05.129051 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a7113-fc10-4122-b0c8-733f6d65a004 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:05.129331 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a7113-fc10-4122-b0c8-733f6d65a004 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:05.129626 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a7113-fc10-4122-b0c8-733f6d65a004 None admin] PATH_INFO: `/v3/roles` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:05.130348 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a7113-fc10-4122-b0c8-733f6d65a004 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:05.130652 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a7113-fc10-4122-b0c8-733f6d65a004 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:05.132137 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a7113-fc10-4122-b0c8-733f6d65a004 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:05.141219 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 115/223] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:27:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:05.146628 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a7113-fc10-4122-b0c8-733f6d65a004 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:05.204225 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 109/224] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:27:05.205675 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d2816-22cf-485e-b9e0-1aad372a518d None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:05.216000 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:05.225957 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:05.270576 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a7113-fc10-4122-b0c8-733f6d65a004 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:05.307102 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a67d4-07a9-4fee-85dc-5c41ee484209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:05.307762 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a67d4-07a9-4fee-85dc-5c41ee484209 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:05.308045 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a67d4-07a9-4fee-85dc-5c41ee484209 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:05.308323 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a67d4-07a9-4fee-85dc-5c41ee484209 None admin] PATH_INFO: `/v3/projects/252e28aa3a004a2c871b20abe82e81ee` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:05.309574 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a67d4-07a9-4fee-85dc-5c41ee484209 None admin] RBAC: Authorizing `identity:get_project(project_id=252e28aa3a004a2c871b20abe82e81ee)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:05.311174 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a67d4-07a9-4fee-85dc-5c41ee484209 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:05.312844 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 116/225] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jul 27 12:27:05 2022] GET /identity/v3/projects/252e28aa3a004a2c871b20abe82e81ee => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:05.313114 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d2816-22cf-485e-b9e0-1aad372a518d None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:05.318963 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a67d4-07a9-4fee-85dc-5c41ee484209 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:05.350515 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04364fc-13e5-46e3-b73e-f9c48bb2caba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:05.351186 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04364fc-13e5-46e3-b73e-f9c48bb2caba None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:05.351546 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04364fc-13e5-46e3-b73e-f9c48bb2caba None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:05.351894 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04364fc-13e5-46e3-b73e-f9c48bb2caba None admin] PATH_INFO: `/v3/users/c765a25ada7147fcacec33b3858eb218` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:05.353159 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04364fc-13e5-46e3-b73e-f9c48bb2caba None admin] RBAC: Authorizing `identity:get_user(user_id=c765a25ada7147fcacec33b3858eb218)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:05.354947 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04364fc-13e5-46e3-b73e-f9c48bb2caba None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:05.356715 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 110/226] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jul 27 12:27:05 2022] GET /identity/v3/users/c765a25ada7147fcacec33b3858eb218 => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:05.357643 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04364fc-13e5-46e3-b73e-f9c48bb2caba None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:05.427943 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a67d4-07a9-4fee-85dc-5c41ee484209 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:05.437933 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:05.464003 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04364fc-13e5-46e3-b73e-f9c48bb2caba None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:05.465900 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96044a-5b23-4ba9-b978-87a8e1c6fff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:05.466653 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96044a-5b23-4ba9-b978-87a8e1c6fff3 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:05.466942 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96044a-5b23-4ba9-b978-87a8e1c6fff3 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:05.467218 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96044a-5b23-4ba9-b978-87a8e1c6fff3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:05.477935 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:05.482478 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b96044a-5b23-4ba9-b978-87a8e1c6fff3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:05.490277 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-9b96044a-5b23-4ba9-b978-87a8e1c6fff3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 12:27:05.490277 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:05.490277 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:05.490277 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:05.490277 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:05.490277 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:05.490277 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:05.490277 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:05.490277 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:05.490277 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:05.490277 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:05.490277 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:05.490277 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:05.490277 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:05.490277 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:05.490277 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:05.491624 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:05.491624 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:05.491624 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:05.491624 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:05.491624 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:05.491624 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:05.491624 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:05.491624 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:05.491624 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:05.491624 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:05.491624 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:05.491624 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:05.491624 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:05.491624 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:05.491624 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:05.491624 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:05.492607 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:05.492607 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:05.492607 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:05.492607 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:05.492607 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:05.492607 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:05.492607 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:05.492607 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:05.492607 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:05.492607 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:05.492607 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 12:27:05.492607 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:05.492607 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 117/227] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jul 27 12:27:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:05.492607 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96044a-5b23-4ba9-b978-87a8e1c6fff3 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:05.511424 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1c49a-23c7-49d1-98e4-bfada5e2969a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:05.512063 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1c49a-23c7-49d1-98e4-bfada5e2969a None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:05.512509 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1c49a-23c7-49d1-98e4-bfada5e2969a None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:05.512920 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1c49a-23c7-49d1-98e4-bfada5e2969a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:05.513749 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba1c49a-23c7-49d1-98e4-bfada5e2969a None admin] RBAC: Adding query filter params (role.id=2136377433854360927c578b39f16e6f, scope.project.id=252e28aa3a004a2c871b20abe82e81ee, user.id=65ae624a1b9042f4912ac9313fb85cf3) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:05.514064 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba1c49a-23c7-49d1-98e4-bfada5e2969a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:05.516056 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba1c49a-23c7-49d1-98e4-bfada5e2969a None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:05.524246 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 111/228] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jul 27 12:27:05 2022] GET /identity/v3/role_assignments?user.id=65ae624a1b9042f4912ac9313fb85cf3&scope.project.id=252e28aa3a004a2c871b20abe82e81ee&role.id=2136377433854360927c578b39f16e6f => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:05.525045 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1c49a-23c7-49d1-98e4-bfada5e2969a None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:05.708978 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1c49a-23c7-49d1-98e4-bfada5e2969a None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:05.715625 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96044a-5b23-4ba9-b978-87a8e1c6fff3 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:05.748773 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44beb38-0166-4cbd-8c91-1b1b840d6905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:05.749407 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44beb38-0166-4cbd-8c91-1b1b840d6905 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:05.749710 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44beb38-0166-4cbd-8c91-1b1b840d6905 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:05.750125 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44beb38-0166-4cbd-8c91-1b1b840d6905 None admin] PATH_INFO: `/v3/roles` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:05.750908 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44beb38-0166-4cbd-8c91-1b1b840d6905 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:05.751218 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44beb38-0166-4cbd-8c91-1b1b840d6905 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:05.753256 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44beb38-0166-4cbd-8c91-1b1b840d6905 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:05.763243 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 112/229] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jul 27 12:27:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:05.768733 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44beb38-0166-4cbd-8c91-1b1b840d6905 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:05.771709 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:05.785474 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034106a-4f60-4d5e-b8cb-a16cd6b59474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:05.786352 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034106a-4f60-4d5e-b8cb-a16cd6b59474 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:05.786782 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034106a-4f60-4d5e-b8cb-a16cd6b59474 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:05.787159 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034106a-4f60-4d5e-b8cb-a16cd6b59474 None admin] PATH_INFO: `/v3/projects/252e28aa3a004a2c871b20abe82e81ee` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:05.789953 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034106a-4f60-4d5e-b8cb-a16cd6b59474 None admin] RBAC: Authorizing `identity:get_project(project_id=252e28aa3a004a2c871b20abe82e81ee)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:05.792287 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034106a-4f60-4d5e-b8cb-a16cd6b59474 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:05.794557 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 118/230] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jul 27 12:27:05 2022] GET /identity/v3/projects/252e28aa3a004a2c871b20abe82e81ee => generated 302 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:05.800753 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034106a-4f60-4d5e-b8cb-a16cd6b59474 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:05.891668 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:05.950364 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034106a-4f60-4d5e-b8cb-a16cd6b59474 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:06.015619 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44beb38-0166-4cbd-8c91-1b1b840d6905 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:06.017791 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62cbce2-13d7-4a06-b01e-c95b85644d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:06.018488 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62cbce2-13d7-4a06-b01e-c95b85644d73 None admin] REQUEST_METHOD: `PUT` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:06.018764 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62cbce2-13d7-4a06-b01e-c95b85644d73 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:06.019035 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62cbce2-13d7-4a06-b01e-c95b85644d73 None admin] PATH_INFO: `/v3/projects/252e28aa3a004a2c871b20abe82e81ee/users/c765a25ada7147fcacec33b3858eb218/roles/af00ed97066e4c72aeb6cd3d5b5d15c9` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:06.026068 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62cbce2-13d7-4a06-b01e-c95b85644d73 None admin] RBAC: Authorizing `identity:create_grant(project_id=252e28aa3a004a2c871b20abe82e81ee, user_id=c765a25ada7147fcacec33b3858eb218, role_id=af00ed97066e4c72aeb6cd3d5b5d15c9)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:06.027540 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62cbce2-13d7-4a06-b01e-c95b85644d73 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:06.047987 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 119/231] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jul 27 12:27:05 2022] PUT /identity/v3/projects/252e28aa3a004a2c871b20abe82e81ee/users/c765a25ada7147fcacec33b3858eb218/roles/af00ed97066e4c72aeb6cd3d5b5d15c9 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 12:27:06.070485 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee2d2e-8ded-4a89-9c82-9e925cbfaa97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:06.071287 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee2d2e-8ded-4a89-9c82-9e925cbfaa97 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:06.071571 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee2d2e-8ded-4a89-9c82-9e925cbfaa97 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:06.071845 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee2d2e-8ded-4a89-9c82-9e925cbfaa97 None admin] PATH_INFO: `/v3/users/c765a25ada7147fcacec33b3858eb218` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:06.073149 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ee2d2e-8ded-4a89-9c82-9e925cbfaa97 None admin] RBAC: Authorizing `identity:get_user(user_id=c765a25ada7147fcacec33b3858eb218)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:06.074701 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ee2d2e-8ded-4a89-9c82-9e925cbfaa97 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:06.076821 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 113/232] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jul 27 12:27:05 2022] GET /identity/v3/users/c765a25ada7147fcacec33b3858eb218 => generated 283 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:06.082614 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62cbce2-13d7-4a06-b01e-c95b85644d73 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:06.203052 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62cbce2-13d7-4a06-b01e-c95b85644d73 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:06.221269 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:06.240306 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4084ab-f49c-4f2e-9807-de49412e1d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:06.241212 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4084ab-f49c-4f2e-9807-de49412e1d5f None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:06.241493 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4084ab-f49c-4f2e-9807-de49412e1d5f None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:06.241798 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4084ab-f49c-4f2e-9807-de49412e1d5f None admin] PATH_INFO: `/v3/projects/252e28aa3a004a2c871b20abe82e81ee` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:06.242950 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4084ab-f49c-4f2e-9807-de49412e1d5f None admin] RBAC: Authorizing `identity:get_project(project_id=252e28aa3a004a2c871b20abe82e81ee)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:06.244429 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4084ab-f49c-4f2e-9807-de49412e1d5f None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:06.246335 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 120/233] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jul 27 12:27:06 2022] GET /identity/v3/projects/252e28aa3a004a2c871b20abe82e81ee => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:06.252986 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee2d2e-8ded-4a89-9c82-9e925cbfaa97 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:06.334599 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:06.373072 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee2d2e-8ded-4a89-9c82-9e925cbfaa97 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:06.418421 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff42089-862e-4e0e-be2a-f007bbbb41a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:06.419134 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff42089-862e-4e0e-be2a-f007bbbb41a9 None admin] REQUEST_METHOD: `PUT` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:06.419419 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff42089-862e-4e0e-be2a-f007bbbb41a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:06.419698 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff42089-862e-4e0e-be2a-f007bbbb41a9 None admin] PATH_INFO: `/v3/projects/252e28aa3a004a2c871b20abe82e81ee/users/c765a25ada7147fcacec33b3858eb218/roles/28c0b3a6358343c398e7df818529a952` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:06.422335 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff42089-862e-4e0e-be2a-f007bbbb41a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=252e28aa3a004a2c871b20abe82e81ee, user_id=c765a25ada7147fcacec33b3858eb218, role_id=28c0b3a6358343c398e7df818529a952)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:06.423817 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff42089-862e-4e0e-be2a-f007bbbb41a9 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:06.440977 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 114/234] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jul 27 12:27:06 2022] PUT /identity/v3/projects/252e28aa3a004a2c871b20abe82e81ee/users/c765a25ada7147fcacec33b3858eb218/roles/28c0b3a6358343c398e7df818529a952 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 12:27:07.162845 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce8b13-fa6b-4c7e-bb77-8132452544fa None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:07.163358 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce8b13-fa6b-4c7e-bb77-8132452544fa None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:07.163461 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce8b13-fa6b-4c7e-bb77-8132452544fa None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:07.164996 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 121/235] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:07.170607 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f790aa-4c43-414a-9546-77ffdf4a20c4 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:07.171109 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f790aa-4c43-414a-9546-77ffdf4a20c4 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:07.171183 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f790aa-4c43-414a-9546-77ffdf4a20c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:07.178155 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb754b0-f7ff-44f2-9159-42c678d85c65 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:07.178479 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb754b0-f7ff-44f2-9159-42c678d85c65 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:07.178719 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb754b0-f7ff-44f2-9159-42c678d85c65 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:07.180480 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 122/236] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:07.187668 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cf08d-da9d-488b-90d4-7f27a9617619 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:07.187960 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cf08d-da9d-488b-90d4-7f27a9617619 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:07.188220 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cf08d-da9d-488b-90d4-7f27a9617619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:07.211718 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-a6f790aa-4c43-414a-9546-77ffdf4a20c4 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:07.212915 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-a6f790aa-4c43-414a-9546-77ffdf4a20c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:07.213587 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-f62cf08d-da9d-488b-90d4-7f27a9617619 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:07.214792 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-f62cf08d-da9d-488b-90d4-7f27a9617619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:07.312514 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 115/237] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:27:07.337817 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f790aa-4c43-414a-9546-77ffdf4a20c4 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:07.362993 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 123/238] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 12:27:07.398840 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:07.403241 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62cf08d-da9d-488b-90d4-7f27a9617619 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:07.442075 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f790aa-4c43-414a-9546-77ffdf4a20c4 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:07.476574 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0abf8c-b05b-4589-93b5-c5b5b21f01dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:07.477220 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0abf8c-b05b-4589-93b5-c5b5b21f01dc None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:07.477499 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0abf8c-b05b-4589-93b5-c5b5b21f01dc None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:07.477803 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0abf8c-b05b-4589-93b5-c5b5b21f01dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:07.478930 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0abf8c-b05b-4589-93b5-c5b5b21f01dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:07.480367 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0abf8c-b05b-4589-93b5-c5b5b21f01dc None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:07.481982 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 116/239] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:27:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:27:07.487841 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0abf8c-b05b-4589-93b5-c5b5b21f01dc None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:07.589436 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0abf8c-b05b-4589-93b5-c5b5b21f01dc None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:07.617979 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:07.625080 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d58efc-309e-4d24-81b5-a089add7cb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:07.625736 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d58efc-309e-4d24-81b5-a089add7cb21 None admin] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:07.626021 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d58efc-309e-4d24-81b5-a089add7cb21 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:07.626298 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d58efc-309e-4d24-81b5-a089add7cb21 None admin] PATH_INFO: `/v3/users` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:07.627438 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d58efc-309e-4d24-81b5-a089add7cb21 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:07.629025 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d58efc-309e-4d24-81b5-a089add7cb21 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:07.652120 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 117/240] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jul 27 12:27:07 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 12:27:07.685889 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62cf08d-da9d-488b-90d4-7f27a9617619 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:07.722965 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:07.752797 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534264bf-ed9b-486e-a7b2-6674a8dfb46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:07.753473 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534264bf-ed9b-486e-a7b2-6674a8dfb46f None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:07.753783 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534264bf-ed9b-486e-a7b2-6674a8dfb46f None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:07.754064 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534264bf-ed9b-486e-a7b2-6674a8dfb46f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:07.770437 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534264bf-ed9b-486e-a7b2-6674a8dfb46f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:07.775651 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-534264bf-ed9b-486e-a7b2-6674a8dfb46f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 12:27:07.775651 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:07.775651 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:07.775651 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:07.775651 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:07.775651 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:07.775651 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:07.775651 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:07.775651 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:07.775651 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:07.775651 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:07.775651 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:07.775651 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:07.775651 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:07.775651 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:07.775651 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:07.778123 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:07.778123 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:07.778123 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:07.778123 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:07.778123 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:07.778123 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:07.778123 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:07.778123 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:07.778123 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:07.778123 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:07.778123 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:07.778123 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:07.778123 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:07.778123 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:07.778123 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:07.778123 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:07.780083 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:07.780083 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:07.780083 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:07.780083 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:07.780083 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:07.780083 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:07.780083 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:07.780083 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:07.780083 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:07.780083 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:07.780083 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 12:27:07.780083 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:07.780083 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 124/241] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:27:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 12:27:07.786747 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d58efc-309e-4d24-81b5-a089add7cb21 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:07.935322 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d58efc-309e-4d24-81b5-a089add7cb21 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:07.972590 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1cf33-b60a-4132-85c8-0b4ef3cd9c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:07.973272 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1cf33-b60a-4132-85c8-0b4ef3cd9c5a None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:07.973497 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1cf33-b60a-4132-85c8-0b4ef3cd9c5a None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:07.973811 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1cf33-b60a-4132-85c8-0b4ef3cd9c5a None admin] PATH_INFO: `/v3/roles` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:07.974535 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1cf33-b60a-4132-85c8-0b4ef3cd9c5a None admin] RBAC: Adding query filter params (name=reader) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:07.974842 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1cf33-b60a-4132-85c8-0b4ef3cd9c5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:07.976217 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1cf33-b60a-4132-85c8-0b4ef3cd9c5a None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:07.989704 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 118/242] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jul 27 12:27:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:07.991809 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534264bf-ed9b-486e-a7b2-6674a8dfb46f None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:08.099703 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534264bf-ed9b-486e-a7b2-6674a8dfb46f None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:08.141514 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48b5a9-e712-47b5-b5d1-d3083796e5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:08.142827 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48b5a9-e712-47b5-b5d1-d3083796e5a1 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:08.143215 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48b5a9-e712-47b5-b5d1-d3083796e5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:08.143489 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48b5a9-e712-47b5-b5d1-d3083796e5a1 None admin] PATH_INFO: `/v3/users/2a507f8f7b3643dcbf9a75667db7baea` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:08.159930 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48b5a9-e712-47b5-b5d1-d3083796e5a1 None admin] RBAC: Authorizing `identity:get_user(user_id=2a507f8f7b3643dcbf9a75667db7baea)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:08.161420 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48b5a9-e712-47b5-b5d1-d3083796e5a1 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:08.163301 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 125/243] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jul 27 12:27:07 2022] GET /identity/v3/users/2a507f8f7b3643dcbf9a75667db7baea => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:08.168886 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1cf33-b60a-4132-85c8-0b4ef3cd9c5a None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:08.223378 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:08.284863 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1cf33-b60a-4132-85c8-0b4ef3cd9c5a None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:08.321250 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570d95b-b8bc-45b2-85e4-c50f5fa28d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:08.321912 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570d95b-b8bc-45b2-85e4-c50f5fa28d10 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:08.322199 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570d95b-b8bc-45b2-85e4-c50f5fa28d10 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:08.322477 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570d95b-b8bc-45b2-85e4-c50f5fa28d10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:08.400743 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570d95b-b8bc-45b2-85e4-c50f5fa28d10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:08.402268 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570d95b-b8bc-45b2-85e4-c50f5fa28d10 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:08.457733 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:08.519285 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 119/244] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jul 27 12:27:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 12:27:08.524940 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48b5a9-e712-47b5-b5d1-d3083796e5a1 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:08.562276 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:08.593292 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daba3c-20d0-4ab5-8684-c4bb7415112f None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:08.593646 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daba3c-20d0-4ab5-8684-c4bb7415112f None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:08.593893 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daba3c-20d0-4ab5-8684-c4bb7415112f None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:08.597544 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 120/245] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 12:27:08.602230 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31aa844-afea-4d22-9164-d01cd3057d31 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:08.602230 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31aa844-afea-4d22-9164-d01cd3057d31 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:08.602230 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31aa844-afea-4d22-9164-d01cd3057d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:08.623385 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-f31aa844-afea-4d22-9164-d01cd3057d31 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:08.625425 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-f31aa844-afea-4d22-9164-d01cd3057d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:08.656175 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48b5a9-e712-47b5-b5d1-d3083796e5a1 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:08.698688 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d392970-be4b-4a0d-a6d7-53b15d835d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:08.699602 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d392970-be4b-4a0d-a6d7-53b15d835d75 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:08.700030 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d392970-be4b-4a0d-a6d7-53b15d835d75 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:08.700448 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d392970-be4b-4a0d-a6d7-53b15d835d75 None admin] PATH_INFO: `/v3/projects/252e28aa3a004a2c871b20abe82e81ee` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:08.701807 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d392970-be4b-4a0d-a6d7-53b15d835d75 None admin] RBAC: Authorizing `identity:get_project(project_id=252e28aa3a004a2c871b20abe82e81ee)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:08.703948 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d392970-be4b-4a0d-a6d7-53b15d835d75 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:08.706420 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 126/246] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jul 27 12:27:08 2022] GET /identity/v3/projects/252e28aa3a004a2c871b20abe82e81ee => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:08.712918 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d392970-be4b-4a0d-a6d7-53b15d835d75 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:08.766768 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 121/247] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 12:27:08.800739 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31aa844-afea-4d22-9164-d01cd3057d31 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:08.902457 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d392970-be4b-4a0d-a6d7-53b15d835d75 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:08.905941 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:08.959882 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:08.961149 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c26188-d0d3-4925-85fa-38c430135d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:08.961808 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c26188-d0d3-4925-85fa-38c430135d34 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:08.962087 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c26188-d0d3-4925-85fa-38c430135d34 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:08.962362 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c26188-d0d3-4925-85fa-38c430135d34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:08.963154 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c26188-d0d3-4925-85fa-38c430135d34 None admin] RBAC: Adding query filter params (role.id=dc674f0d3e424f7baef5700ad3f7ff65, scope.project.id=252e28aa3a004a2c871b20abe82e81ee, user.id=2a507f8f7b3643dcbf9a75667db7baea) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:08.963458 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c26188-d0d3-4925-85fa-38c430135d34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:08.964902 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c26188-d0d3-4925-85fa-38c430135d34 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:08.976619 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 127/248] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jul 27 12:27:08 2022] GET /identity/v3/role_assignments?user.id=2a507f8f7b3643dcbf9a75667db7baea&scope.project.id=252e28aa3a004a2c871b20abe82e81ee&role.id=dc674f0d3e424f7baef5700ad3f7ff65 => generated 259 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:09.006022 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31aa844-afea-4d22-9164-d01cd3057d31 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:09.062607 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf7d86-1fdb-4acd-8af5-5b241c1e88ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:09.063201 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf7d86-1fdb-4acd-8af5-5b241c1e88ec None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:09.063483 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf7d86-1fdb-4acd-8af5-5b241c1e88ec None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:09.063755 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf7d86-1fdb-4acd-8af5-5b241c1e88ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:09.082770 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf7d86-1fdb-4acd-8af5-5b241c1e88ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:09.087882 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-cecf7d86-1fdb-4acd-8af5-5b241c1e88ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 12:27:09.087882 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:09.087882 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:09.087882 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:09.087882 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:09.087882 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:09.087882 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:09.087882 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:09.087882 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:09.087882 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:09.087882 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:09.087882 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:09.087882 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:09.087882 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:09.087882 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:09.087882 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:09.088832 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:09.088832 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:09.088832 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:09.088832 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:09.088832 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:09.088832 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:09.088832 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:09.088832 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:09.088832 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:09.088832 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:09.088832 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:09.088832 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:09.088832 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:09.088832 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:09.088832 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:09.088832 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:09.090060 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:09.090060 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:09.090060 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:09.090060 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:09.090060 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:09.090060 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:09.090060 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:09.090060 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:09.090060 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:09.090060 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:09.090060 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 12:27:09.090060 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:09.090060 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 122/249] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:27:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:09.098820 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c26188-d0d3-4925-85fa-38c430135d34 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:09.170271 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29ed88-a31b-4e53-ae7b-6d4a73f9432a None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:09.170557 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29ed88-a31b-4e53-ae7b-6d4a73f9432a None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:09.171572 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29ed88-a31b-4e53-ae7b-6d4a73f9432a None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:09.173192 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 123/250] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 12:27:09.179235 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a365458-1db2-4a4d-970b-e1b8e97c84a8 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:09.179789 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a365458-1db2-4a4d-970b-e1b8e97c84a8 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:09.180429 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a365458-1db2-4a4d-970b-e1b8e97c84a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:09.216365 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-7a365458-1db2-4a4d-970b-e1b8e97c84a8 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:09.218129 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-7a365458-1db2-4a4d-970b-e1b8e97c84a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:09.308659 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 124/251] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:27:09.317452 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c26188-d0d3-4925-85fa-38c430135d34 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:09.319766 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb68b2-ca7d-4965-aaab-b6abc690e6fb None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:09.320297 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb68b2-ca7d-4965-aaab-b6abc690e6fb None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:09.320775 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb68b2-ca7d-4965-aaab-b6abc690e6fb None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:09.322408 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 125/252] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:09.327990 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620006a-d1ae-415f-9d8a-7fc371146fbb None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:09.328606 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620006a-d1ae-415f-9d8a-7fc371146fbb None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:09.329081 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620006a-d1ae-415f-9d8a-7fc371146fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:09.356521 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-a620006a-d1ae-415f-9d8a-7fc371146fbb None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:09.357907 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-a620006a-d1ae-415f-9d8a-7fc371146fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:09.373202 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba845ee-8782-40d7-b023-7cb82fb4ae87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:09.374258 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba845ee-8782-40d7-b023-7cb82fb4ae87 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:09.374960 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba845ee-8782-40d7-b023-7cb82fb4ae87 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:09.375901 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba845ee-8782-40d7-b023-7cb82fb4ae87 None admin] PATH_INFO: `/v3/roles` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:09.377678 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba845ee-8782-40d7-b023-7cb82fb4ae87 None admin] RBAC: Adding query filter params (name=member) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:09.378190 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba845ee-8782-40d7-b023-7cb82fb4ae87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:09.380405 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba845ee-8782-40d7-b023-7cb82fb4ae87 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:09.391817 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 128/253] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jul 27 12:27:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:09.392911 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba845ee-8782-40d7-b023-7cb82fb4ae87 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:09.427314 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:09.459645 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:09.478767 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 126/254] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:27:09.479881 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620006a-d1ae-415f-9d8a-7fc371146fbb None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:09.521354 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba845ee-8782-40d7-b023-7cb82fb4ae87 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:09.563062 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6ed5a-345c-4131-b9b9-de502fd4f563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:09.564154 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6ed5a-345c-4131-b9b9-de502fd4f563 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:09.565146 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6ed5a-345c-4131-b9b9-de502fd4f563 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:09.565697 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6ed5a-345c-4131-b9b9-de502fd4f563 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:09.578219 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa6ed5a-345c-4131-b9b9-de502fd4f563 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:09.585798 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-ffa6ed5a-345c-4131-b9b9-de502fd4f563 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 12:27:09.585798 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:09.585798 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:09.585798 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:09.585798 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:09.585798 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:09.585798 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:09.585798 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:09.585798 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:09.585798 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:09.585798 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:09.585798 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:09.585798 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:09.585798 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:09.585798 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:09.585798 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:09.586671 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:09.586671 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:09.586671 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:09.586671 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:09.586671 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:09.586671 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:09.586671 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:09.586671 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:09.586671 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:09.586671 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:09.586671 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:09.586671 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:09.586671 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:09.586671 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:09.586671 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:09.586671 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:09.587448 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:09.587448 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:09.587448 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:09.587448 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:09.587448 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:09.587448 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:09.587448 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:09.587448 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:09.587448 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:09.587448 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:09.587448 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 12:27:09.587448 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:09.590330 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 129/255] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jul 27 12:27:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:09.591793 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6ed5a-345c-4131-b9b9-de502fd4f563 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:09.648775 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620006a-d1ae-415f-9d8a-7fc371146fbb None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:09.692163 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e84f8-3758-4b68-941d-2ed5f95ddc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:09.692681 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e84f8-3758-4b68-941d-2ed5f95ddc01 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:09.693153 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e84f8-3758-4b68-941d-2ed5f95ddc01 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:09.693559 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e84f8-3758-4b68-941d-2ed5f95ddc01 None admin] PATH_INFO: `/v3/users/65ae624a1b9042f4912ac9313fb85cf3` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:09.698410 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e84f8-3758-4b68-941d-2ed5f95ddc01 None admin] RBAC: Authorizing `identity:get_user(user_id=65ae624a1b9042f4912ac9313fb85cf3)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:09.700198 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e84f8-3758-4b68-941d-2ed5f95ddc01 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:09.706801 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 127/256] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jul 27 12:27:09 2022] GET /identity/v3/users/65ae624a1b9042f4912ac9313fb85cf3 => generated 297 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:09.707881 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e84f8-3758-4b68-941d-2ed5f95ddc01 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:09.725469 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:09.759725 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6ed5a-345c-4131-b9b9-de502fd4f563 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:09.794522 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:09.834307 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e84f8-3758-4b68-941d-2ed5f95ddc01 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:09.862305 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a9251-5ac1-48a8-ac26-1b7ac6384b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:09.863122 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a9251-5ac1-48a8-ac26-1b7ac6384b4f None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:09.863551 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a9251-5ac1-48a8-ac26-1b7ac6384b4f None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:09.863895 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a9251-5ac1-48a8-ac26-1b7ac6384b4f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:09.870309 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d825f-86ec-4a42-a923-dbd59ef6b54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:09.871161 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d825f-86ec-4a42-a923-dbd59ef6b54f None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:09.871623 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d825f-86ec-4a42-a923-dbd59ef6b54f None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:09.872077 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d825f-86ec-4a42-a923-dbd59ef6b54f None admin] PATH_INFO: `/v3/roles` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:09.873125 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d825f-86ec-4a42-a923-dbd59ef6b54f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:09.873620 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d825f-86ec-4a42-a923-dbd59ef6b54f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:09.875152 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d825f-86ec-4a42-a923-dbd59ef6b54f None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:09.884970 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 128/257] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:27:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:09.886017 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d825f-86ec-4a42-a923-dbd59ef6b54f None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:09.889748 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a9251-5ac1-48a8-ac26-1b7ac6384b4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:09.902660 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-5b8a9251-5ac1-48a8-ac26-1b7ac6384b4f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 12:27:09.902660 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:09.902660 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:09.902660 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:09.902660 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:09.902660 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:09.902660 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:09.902660 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:09.902660 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:09.902660 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:09.902660 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:09.902660 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:09.902660 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:09.902660 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:09.902660 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:09.902660 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:09.903570 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:09.903570 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:09.903570 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:09.903570 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:09.903570 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:09.903570 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:09.903570 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:09.903570 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:09.903570 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:09.903570 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:09.903570 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:09.903570 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:09.903570 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:09.903570 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:09.903570 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:09.903570 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:09.904359 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:09.904359 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:09.904359 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:09.904359 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:09.904359 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:09.904359 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:09.904359 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:09.904359 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:09.904359 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:09.904359 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:09.904359 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 12:27:09.904359 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:09.906810 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 130/258] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jul 27 12:27:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:09.912071 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a9251-5ac1-48a8-ac26-1b7ac6384b4f None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:10.023340 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d825f-86ec-4a42-a923-dbd59ef6b54f None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:10.074865 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:10.092341 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a9251-5ac1-48a8-ac26-1b7ac6384b4f None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:10.093283 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b83946-b906-41f7-9900-d3ebda797d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:10.094182 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b83946-b906-41f7-9900-d3ebda797d21 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:10.094696 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b83946-b906-41f7-9900-d3ebda797d21 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:10.096234 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b83946-b906-41f7-9900-d3ebda797d21 None admin] PATH_INFO: `/v3/projects/252e28aa3a004a2c871b20abe82e81ee` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:10.097695 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b83946-b906-41f7-9900-d3ebda797d21 None admin] RBAC: Authorizing `identity:get_project(project_id=252e28aa3a004a2c871b20abe82e81ee)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:10.100413 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b83946-b906-41f7-9900-d3ebda797d21 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:10.110335 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 129/259] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jul 27 12:27:09 2022] GET /identity/v3/projects/252e28aa3a004a2c871b20abe82e81ee => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:10.111522 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b83946-b906-41f7-9900-d3ebda797d21 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:10.168373 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c3217-7820-4543-89cc-2a7a6a3ee7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:10.170836 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c3217-7820-4543-89cc-2a7a6a3ee7c9 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:10.171359 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c3217-7820-4543-89cc-2a7a6a3ee7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:10.171855 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c3217-7820-4543-89cc-2a7a6a3ee7c9 None admin] PATH_INFO: `/v3/users/c765a25ada7147fcacec33b3858eb218` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:10.174800 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c3217-7820-4543-89cc-2a7a6a3ee7c9 None admin] RBAC: Authorizing `identity:get_user(user_id=c765a25ada7147fcacec33b3858eb218)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:10.177810 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c3217-7820-4543-89cc-2a7a6a3ee7c9 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:10.185083 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 131/260] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jul 27 12:27:09 2022] GET /identity/v3/users/c765a25ada7147fcacec33b3858eb218 => generated 283 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:10.186186 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c3217-7820-4543-89cc-2a7a6a3ee7c9 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:10.220873 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:10.296822 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b83946-b906-41f7-9900-d3ebda797d21 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:10.366269 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4795ab72-a446-4fd6-94c4-9c60e408847c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:10.366864 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795ab72-a446-4fd6-94c4-9c60e408847c None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:10.367198 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795ab72-a446-4fd6-94c4-9c60e408847c None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:10.367479 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795ab72-a446-4fd6-94c4-9c60e408847c None admin] PATH_INFO: `/v3/roles` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:10.368248 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4795ab72-a446-4fd6-94c4-9c60e408847c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:10.368557 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4795ab72-a446-4fd6-94c4-9c60e408847c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:10.369966 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4795ab72-a446-4fd6-94c4-9c60e408847c None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:10.374007 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c3217-7820-4543-89cc-2a7a6a3ee7c9 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:10.382238 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 130/261] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jul 27 12:27:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:10.383384 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4795ab72-a446-4fd6-94c4-9c60e408847c None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:10.426902 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d997003-109d-4f24-8bc2-45c187ccc2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:10.427585 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d997003-109d-4f24-8bc2-45c187ccc2ef None admin] REQUEST_METHOD: `PUT` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:10.427920 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d997003-109d-4f24-8bc2-45c187ccc2ef None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:10.428204 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d997003-109d-4f24-8bc2-45c187ccc2ef None admin] PATH_INFO: `/v3/projects/252e28aa3a004a2c871b20abe82e81ee/users/65ae624a1b9042f4912ac9313fb85cf3/roles/2136377433854360927c578b39f16e6f` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:10.433168 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d997003-109d-4f24-8bc2-45c187ccc2ef None admin] RBAC: Authorizing `identity:create_grant(project_id=252e28aa3a004a2c871b20abe82e81ee, user_id=65ae624a1b9042f4912ac9313fb85cf3, role_id=2136377433854360927c578b39f16e6f)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:10.435552 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d997003-109d-4f24-8bc2-45c187ccc2ef None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:10.455390 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:10.465721 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 132/262] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jul 27 12:27:10 2022] PUT /identity/v3/projects/252e28aa3a004a2c871b20abe82e81ee/users/65ae624a1b9042f4912ac9313fb85cf3/roles/2136377433854360927c578b39f16e6f => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 12:27:10.466617 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d997003-109d-4f24-8bc2-45c187ccc2ef None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:10.559253 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4795ab72-a446-4fd6-94c4-9c60e408847c None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:10.638482 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:10.639262 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d2c93-6108-4ba3-a24c-e86d71fefbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:10.639904 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d2c93-6108-4ba3-a24c-e86d71fefbda None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:10.640190 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d2c93-6108-4ba3-a24c-e86d71fefbda None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:10.640473 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d2c93-6108-4ba3-a24c-e86d71fefbda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:10.693767 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d997003-109d-4f24-8bc2-45c187ccc2ef None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:10.742767 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d234bfa-d014-453c-8f52-76031f85ce15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:10.743449 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d234bfa-d014-453c-8f52-76031f85ce15 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:10.743817 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d234bfa-d014-453c-8f52-76031f85ce15 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:10.744103 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d234bfa-d014-453c-8f52-76031f85ce15 None admin] PATH_INFO: `/v3/users/c765a25ada7147fcacec33b3858eb218` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:10.745389 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d234bfa-d014-453c-8f52-76031f85ce15 None admin] RBAC: Authorizing `identity:get_user(user_id=c765a25ada7147fcacec33b3858eb218)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:10.746883 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d234bfa-d014-453c-8f52-76031f85ce15 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:10.748758 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 133/263] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jul 27 12:27:10 2022] GET /identity/v3/users/c765a25ada7147fcacec33b3858eb218 => generated 283 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:10.761248 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d234bfa-d014-453c-8f52-76031f85ce15 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:10.763464 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d2c93-6108-4ba3-a24c-e86d71fefbda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:10.765434 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d2c93-6108-4ba3-a24c-e86d71fefbda None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:10.859475 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:10.881319 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d234bfa-d014-453c-8f52-76031f85ce15 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:10.920623 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b5141-526a-422c-930a-ebbadba52264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:10.921671 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b5141-526a-422c-930a-ebbadba52264 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:10.922100 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b5141-526a-422c-930a-ebbadba52264 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:10.922519 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b5141-526a-422c-930a-ebbadba52264 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:10.941841 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:10.945907 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 131/264] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jul 27 12:27:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 12:27:10.951090 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d2c93-6108-4ba3-a24c-e86d71fefbda None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:11.004451 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b5141-526a-422c-930a-ebbadba52264 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:11.006407 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b5141-526a-422c-930a-ebbadba52264 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:11.229846 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d2c93-6108-4ba3-a24c-e86d71fefbda None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:11.318025 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42047d78-aa28-4987-ac91-87a7caccb6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:11.318691 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42047d78-aa28-4987-ac91-87a7caccb6ac None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:11.318978 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42047d78-aa28-4987-ac91-87a7caccb6ac None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:11.319256 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42047d78-aa28-4987-ac91-87a7caccb6ac None admin] PATH_INFO: `/v3/projects/252e28aa3a004a2c871b20abe82e81ee` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:11.326376 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42047d78-aa28-4987-ac91-87a7caccb6ac None admin] RBAC: Authorizing `identity:get_project(project_id=252e28aa3a004a2c871b20abe82e81ee)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:11.327856 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42047d78-aa28-4987-ac91-87a7caccb6ac None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:11.329957 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 132/265] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jul 27 12:27:10 2022] GET /identity/v3/projects/252e28aa3a004a2c871b20abe82e81ee => generated 302 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:27:11.335400 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 134/266] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jul 27 12:27:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 12:27:11.335805 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42047d78-aa28-4987-ac91-87a7caccb6ac None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:11.336432 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b5141-526a-422c-930a-ebbadba52264 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:11.409966 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:11.464252 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:11.525812 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b5141-526a-422c-930a-ebbadba52264 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:11.539767 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42047d78-aa28-4987-ac91-87a7caccb6ac None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:11.564155 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c353f9d-226d-4cb6-b03c-56d61d94d4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:11.565260 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c353f9d-226d-4cb6-b03c-56d61d94d4f4 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:11.565780 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c353f9d-226d-4cb6-b03c-56d61d94d4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:11.566389 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c353f9d-226d-4cb6-b03c-56d61d94d4f4 None admin] PATH_INFO: `/v3/projects/252e28aa3a004a2c871b20abe82e81ee` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:11.567956 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c353f9d-226d-4cb6-b03c-56d61d94d4f4 None admin] RBAC: Authorizing `identity:get_project(project_id=252e28aa3a004a2c871b20abe82e81ee)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:11.569697 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c353f9d-226d-4cb6-b03c-56d61d94d4f4 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:11.572208 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 135/267] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jul 27 12:27:11 2022] GET /identity/v3/projects/252e28aa3a004a2c871b20abe82e81ee => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:11.573696 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57ba0d-8931-465a-b09e-0c31443da853 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:11.574282 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57ba0d-8931-465a-b09e-0c31443da853 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:11.574758 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57ba0d-8931-465a-b09e-0c31443da853 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:11.576398 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 136/268] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:11.577859 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce0e3e-dba5-4cd9-8493-6b26015c772d None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:11.578363 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce0e3e-dba5-4cd9-8493-6b26015c772d None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:11.578835 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce0e3e-dba5-4cd9-8493-6b26015c772d None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:11.581036 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 137/269] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:11.585889 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae333ba-7765-4c75-a468-5feaabef1583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:11.586242 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce0e3e-dba5-4cd9-8493-6b26015c772d None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:11.586519 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae333ba-7765-4c75-a468-5feaabef1583 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:11.586973 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae333ba-7765-4c75-a468-5feaabef1583 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:11.587254 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae333ba-7765-4c75-a468-5feaabef1583 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:11.588052 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae333ba-7765-4c75-a468-5feaabef1583 None admin] RBAC: Adding query filter params (role.id=af00ed97066e4c72aeb6cd3d5b5d15c9, scope.project.id=252e28aa3a004a2c871b20abe82e81ee, user.id=c765a25ada7147fcacec33b3858eb218) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:11.588367 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae333ba-7765-4c75-a468-5feaabef1583 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:11.589846 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae333ba-7765-4c75-a468-5feaabef1583 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:11.596728 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 133/270] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jul 27 12:27:11 2022] GET /identity/v3/role_assignments?user.id=c765a25ada7147fcacec33b3858eb218&scope.project.id=252e28aa3a004a2c871b20abe82e81ee&role.id=af00ed97066e4c72aeb6cd3d5b5d15c9 => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:27:11.598096 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d5bbd-aca1-4760-9dba-ae3da2163498 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:11.598382 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d5bbd-aca1-4760-9dba-ae3da2163498 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:11.598661 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d5bbd-aca1-4760-9dba-ae3da2163498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:11.617647 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-6e2d5bbd-aca1-4760-9dba-ae3da2163498 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:11.619241 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-6e2d5bbd-aca1-4760-9dba-ae3da2163498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:11.762336 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 134/271] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:27:11.763577 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7c1ba-a7cf-4c5d-8ff3-9e41e8fed367 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:11.763869 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7c1ba-a7cf-4c5d-8ff3-9e41e8fed367 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:11.765692 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7c1ba-a7cf-4c5d-8ff3-9e41e8fed367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:11.806429 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-21c7c1ba-a7cf-4c5d-8ff3-9e41e8fed367 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:11.807576 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-21c7c1ba-a7cf-4c5d-8ff3-9e41e8fed367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:11.818590 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce0e3e-dba5-4cd9-8493-6b26015c772d None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:11.825964 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:11.833565 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:11.862069 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40415cbe-95ed-4af2-b9d9-8670fa4ab793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:11.862793 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40415cbe-95ed-4af2-b9d9-8670fa4ab793 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:11.863084 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40415cbe-95ed-4af2-b9d9-8670fa4ab793 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:11.863364 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40415cbe-95ed-4af2-b9d9-8670fa4ab793 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:11.864154 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40415cbe-95ed-4af2-b9d9-8670fa4ab793 None admin] RBAC: Adding query filter params (role.id=28c0b3a6358343c398e7df818529a952, scope.project.id=252e28aa3a004a2c871b20abe82e81ee, user.id=c765a25ada7147fcacec33b3858eb218) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:11.864499 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40415cbe-95ed-4af2-b9d9-8670fa4ab793 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:11.866484 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40415cbe-95ed-4af2-b9d9-8670fa4ab793 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:11.873560 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 138/272] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jul 27 12:27:11 2022] GET /identity/v3/role_assignments?user.id=c765a25ada7147fcacec33b3858eb218&scope.project.id=252e28aa3a004a2c871b20abe82e81ee&role.id=28c0b3a6358343c398e7df818529a952 => generated 608 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:11.874592 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40415cbe-95ed-4af2-b9d9-8670fa4ab793 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:11.899664 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 135/273] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:27:11.926810 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7c1ba-a7cf-4c5d-8ff3-9e41e8fed367 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:12.014403 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40415cbe-95ed-4af2-b9d9-8670fa4ab793 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:12.096993 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd842de3-da99-4524-81bd-46f127441daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:12.097582 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd842de3-da99-4524-81bd-46f127441daa None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:12.097886 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd842de3-da99-4524-81bd-46f127441daa None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:12.098162 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd842de3-da99-4524-81bd-46f127441daa None admin] PATH_INFO: `/v3/domains/default` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:12.100723 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd842de3-da99-4524-81bd-46f127441daa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:12.100854 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7c1ba-a7cf-4c5d-8ff3-9e41e8fed367 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:12.102243 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd842de3-da99-4524-81bd-46f127441daa None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:12.103917 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 139/274] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:27:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:12.110924 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd842de3-da99-4524-81bd-46f127441daa None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:12.141820 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4357e0-93a2-4ee2-88d7-3a3e77304d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:12.143075 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4357e0-93a2-4ee2-88d7-3a3e77304d3c None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:12.143410 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4357e0-93a2-4ee2-88d7-3a3e77304d3c None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:12.143696 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4357e0-93a2-4ee2-88d7-3a3e77304d3c None admin] PATH_INFO: `/v3/roles/member` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:12.155657 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4357e0-93a2-4ee2-88d7-3a3e77304d3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:12.160781 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-cd4357e0-93a2-4ee2-88d7-3a3e77304d3c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 12:27:12.160781 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:12.160781 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:12.160781 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:12.160781 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:12.160781 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:12.160781 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:12.160781 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:12.160781 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:12.160781 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:12.160781 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:12.160781 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:12.160781 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:12.160781 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:12.160781 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:12.160781 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:12.163764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:12.163764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:12.163764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:12.163764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:12.163764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:12.163764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:12.163764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:12.163764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:12.163764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:12.163764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:12.163764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:12.163764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:12.163764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:12.163764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:12.163764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:12.163764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:12.165882 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:12.165882 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:12.165882 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:12.165882 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:12.165882 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:12.165882 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:12.165882 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:12.165882 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:12.165882 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:12.165882 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:12.165882 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 12:27:12.165882 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:12.165882 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 136/275] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:27:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:12.168587 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4357e0-93a2-4ee2-88d7-3a3e77304d3c None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:12.180792 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:12.184689 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:12.247434 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd842de3-da99-4524-81bd-46f127441daa None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:12.283135 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4357e0-93a2-4ee2-88d7-3a3e77304d3c None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:12.285352 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291b177-c407-480f-8752-cc5bb0c02a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:12.286020 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291b177-c407-480f-8752-cc5bb0c02a93 None admin] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:12.286303 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291b177-c407-480f-8752-cc5bb0c02a93 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:12.286579 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291b177-c407-480f-8752-cc5bb0c02a93 None admin] PATH_INFO: `/v3/users` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:12.287301 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0291b177-c407-480f-8752-cc5bb0c02a93 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:12.289363 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0291b177-c407-480f-8752-cc5bb0c02a93 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:12.314153 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 140/276] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jul 27 12:27:12 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 12:27:12.315945 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c678b-5253-4cb8-a8bb-74f903345399 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:12.316241 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c678b-5253-4cb8-a8bb-74f903345399 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:12.316538 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c678b-5253-4cb8-a8bb-74f903345399 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:12.318420 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 141/277] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:12.324303 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24286738-5faa-4993-9e50-b13888399097 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:12.324596 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24286738-5faa-4993-9e50-b13888399097 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:12.324866 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24286738-5faa-4993-9e50-b13888399097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:12.331242 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a192823-7c64-4292-9e04-622aee60925b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:12.332316 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a192823-7c64-4292-9e04-622aee60925b None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:12.332812 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a192823-7c64-4292-9e04-622aee60925b None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:12.333286 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a192823-7c64-4292-9e04-622aee60925b None admin] PATH_INFO: `/v3/roles` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:12.334255 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a192823-7c64-4292-9e04-622aee60925b None admin] RBAC: Adding query filter params (name=member) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:12.334797 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a192823-7c64-4292-9e04-622aee60925b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:12.337402 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a192823-7c64-4292-9e04-622aee60925b None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:12.345499 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-24286738-5faa-4993-9e50-b13888399097 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:12.346768 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-24286738-5faa-4993-9e50-b13888399097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:12.353328 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 137/278] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jul 27 12:27:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:27:12.355098 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a192823-7c64-4292-9e04-622aee60925b None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:12.457752 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 142/279] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 12:27:12.484682 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24286738-5faa-4993-9e50-b13888399097 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:12.491629 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:12.522837 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:12.532094 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a192823-7c64-4292-9e04-622aee60925b None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:12.570015 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6338d-2267-4fc2-a611-8aa10ac8b7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:12.570677 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6338d-2267-4fc2-a611-8aa10ac8b7d6 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:12.570969 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6338d-2267-4fc2-a611-8aa10ac8b7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:12.571251 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6338d-2267-4fc2-a611-8aa10ac8b7d6 None admin] PATH_INFO: `/v3/users/58bc697b590345558b566620ed1b0908` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:12.585563 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6338d-2267-4fc2-a611-8aa10ac8b7d6 None admin] RBAC: Authorizing `identity:get_user(user_id=58bc697b590345558b566620ed1b0908)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:12.587061 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6338d-2267-4fc2-a611-8aa10ac8b7d6 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:12.589116 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 138/280] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jul 27 12:27:12 2022] GET /identity/v3/users/58bc697b590345558b566620ed1b0908 => generated 293 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:12.595010 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6338d-2267-4fc2-a611-8aa10ac8b7d6 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:12.600976 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24286738-5faa-4993-9e50-b13888399097 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:12.644358 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981764d-ac43-41f4-ae3f-86e6b34d5734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:12.644933 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981764d-ac43-41f4-ae3f-86e6b34d5734 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:12.645218 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981764d-ac43-41f4-ae3f-86e6b34d5734 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:12.645492 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981764d-ac43-41f4-ae3f-86e6b34d5734 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:12.658306 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981764d-ac43-41f4-ae3f-86e6b34d5734 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:12.663913 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-f981764d-ac43-41f4-ae3f-86e6b34d5734 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 12:27:12.663913 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:12.663913 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:12.663913 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:12.663913 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:12.663913 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:12.663913 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:12.663913 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:12.663913 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:12.663913 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:12.663913 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:12.663913 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:12.663913 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:12.663913 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:12.663913 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:12.663913 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:12.664850 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:12.664850 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:12.664850 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:12.664850 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:12.664850 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:12.664850 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:12.664850 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:12.664850 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:12.664850 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:12.664850 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:12.664850 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:12.664850 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:12.664850 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:12.664850 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:12.664850 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:12.664850 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:12.665671 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:12.665671 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:12.665671 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:12.665671 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:12.665671 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:12.665671 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:12.665671 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:12.665671 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:12.665671 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:12.665671 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:12.665671 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 12:27:12.665671 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:12.666676 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 143/281] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:27:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 12:27:12.672154 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981764d-ac43-41f4-ae3f-86e6b34d5734 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:12.733154 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6338d-2267-4fc2-a611-8aa10ac8b7d6 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:12.766882 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:12.782017 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd9d65-bad3-4c66-991d-805b908c6613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:12.785761 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd9d65-bad3-4c66-991d-805b908c6613 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:12.787216 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd9d65-bad3-4c66-991d-805b908c6613 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:12.787216 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd9d65-bad3-4c66-991d-805b908c6613 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:12.788271 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bd9d65-bad3-4c66-991d-805b908c6613 None admin] RBAC: Adding query filter params (role.id=2136377433854360927c578b39f16e6f, user.id=58bc697b590345558b566620ed1b0908, scope.system=all) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:12.793912 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bd9d65-bad3-4c66-991d-805b908c6613 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:12.796534 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bd9d65-bad3-4c66-991d-805b908c6613 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:12.805049 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 139/282] 10.222.0.55 () {56 vars in 1308 bytes} [Wed Jul 27 12:27:12 2022] GET /identity/v3/role_assignments?user.id=58bc697b590345558b566620ed1b0908&scope.system=all&role.id=2136377433854360927c578b39f16e6f => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:27:12.822914 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:12.834798 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981764d-ac43-41f4-ae3f-86e6b34d5734 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:12.876030 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283cf2c-2db9-4d7f-a4f1-1faa16d2e524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:12.877206 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283cf2c-2db9-4d7f-a4f1-1faa16d2e524 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:12.877488 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283cf2c-2db9-4d7f-a4f1-1faa16d2e524 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:12.877803 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283cf2c-2db9-4d7f-a4f1-1faa16d2e524 None admin] PATH_INFO: `/v3/roles` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:12.878535 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0283cf2c-2db9-4d7f-a4f1-1faa16d2e524 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:12.878841 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0283cf2c-2db9-4d7f-a4f1-1faa16d2e524 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:12.880248 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0283cf2c-2db9-4d7f-a4f1-1faa16d2e524 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:12.891110 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 144/283] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jul 27 12:27:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:27:12.897349 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd9d65-bad3-4c66-991d-805b908c6613 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:13.014933 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd9d65-bad3-4c66-991d-805b908c6613 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:13.053529 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab616073-44ca-43b1-8e58-7dc749c04cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:13.054220 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab616073-44ca-43b1-8e58-7dc749c04cc5 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:13.054502 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab616073-44ca-43b1-8e58-7dc749c04cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:13.054773 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab616073-44ca-43b1-8e58-7dc749c04cc5 None admin] PATH_INFO: `/v3/users/2a507f8f7b3643dcbf9a75667db7baea` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:13.056073 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab616073-44ca-43b1-8e58-7dc749c04cc5 None admin] RBAC: Authorizing `identity:get_user(user_id=2a507f8f7b3643dcbf9a75667db7baea)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:13.057540 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab616073-44ca-43b1-8e58-7dc749c04cc5 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:13.059548 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 140/284] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jul 27 12:27:12 2022] GET /identity/v3/users/2a507f8f7b3643dcbf9a75667db7baea => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:13.065220 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283cf2c-2db9-4d7f-a4f1-1faa16d2e524 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:13.173026 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283cf2c-2db9-4d7f-a4f1-1faa16d2e524 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:13.208351 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124f699-38df-4e18-a3b5-ff5dc8272f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:13.209007 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124f699-38df-4e18-a3b5-ff5dc8272f8e None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:13.209291 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124f699-38df-4e18-a3b5-ff5dc8272f8e None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:13.209569 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124f699-38df-4e18-a3b5-ff5dc8272f8e None admin] PATH_INFO: `/v3/projects/252e28aa3a004a2c871b20abe82e81ee` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:13.210760 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1124f699-38df-4e18-a3b5-ff5dc8272f8e None admin] RBAC: Authorizing `identity:get_project(project_id=252e28aa3a004a2c871b20abe82e81ee)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:13.212200 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1124f699-38df-4e18-a3b5-ff5dc8272f8e None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:13.214264 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 145/285] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jul 27 12:27:13 2022] GET /identity/v3/projects/252e28aa3a004a2c871b20abe82e81ee => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:13.219994 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab616073-44ca-43b1-8e58-7dc749c04cc5 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:13.287053 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:13.331900 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab616073-44ca-43b1-8e58-7dc749c04cc5 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:13.367568 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2edf7eb-75d3-4780-925e-045d05cf0758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:13.368245 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2edf7eb-75d3-4780-925e-045d05cf0758 None admin] REQUEST_METHOD: `PUT` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:13.368529 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2edf7eb-75d3-4780-925e-045d05cf0758 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:13.368805 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2edf7eb-75d3-4780-925e-045d05cf0758 None admin] PATH_INFO: `/v3/projects/252e28aa3a004a2c871b20abe82e81ee/users/2a507f8f7b3643dcbf9a75667db7baea/roles/dc674f0d3e424f7baef5700ad3f7ff65` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:13.370806 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2edf7eb-75d3-4780-925e-045d05cf0758 None admin] RBAC: Authorizing `identity:create_grant(project_id=252e28aa3a004a2c871b20abe82e81ee, user_id=2a507f8f7b3643dcbf9a75667db7baea, role_id=dc674f0d3e424f7baef5700ad3f7ff65)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:13.372250 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2edf7eb-75d3-4780-925e-045d05cf0758 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:13.387931 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 141/286] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jul 27 12:27:13 2022] PUT /identity/v3/projects/252e28aa3a004a2c871b20abe82e81ee/users/2a507f8f7b3643dcbf9a75667db7baea/roles/dc674f0d3e424f7baef5700ad3f7ff65 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 12:27:13.588821 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67f17f-c702-4e6f-9745-e5b69e70c30c None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:13.588821 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67f17f-c702-4e6f-9745-e5b69e70c30c None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:13.588821 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67f17f-c702-4e6f-9745-e5b69e70c30c None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:13.588821 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 146/287] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:13.607635 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725a07a-8f84-475c-a67a-cfecc010d7f4 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:13.608175 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725a07a-8f84-475c-a67a-cfecc010d7f4 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:13.608175 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725a07a-8f84-475c-a67a-cfecc010d7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:13.634805 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-5725a07a-8f84-475c-a67a-cfecc010d7f4 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:13.636150 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-5725a07a-8f84-475c-a67a-cfecc010d7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:13.716676 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 142/288] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:27:13.742304 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a67f17f-c702-4e6f-9745-e5b69e70c30c None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:13.766620 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:13.851464 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a67f17f-c702-4e6f-9745-e5b69e70c30c None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:13.887476 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83051810-fc05-4559-919e-021c7184497f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:13.888126 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83051810-fc05-4559-919e-021c7184497f None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:13.888405 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83051810-fc05-4559-919e-021c7184497f None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:13.888738 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83051810-fc05-4559-919e-021c7184497f None admin] PATH_INFO: `/v3/roles/member` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:13.903487 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83051810-fc05-4559-919e-021c7184497f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:13.909222 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-83051810-fc05-4559-919e-021c7184497f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 12:27:13.909222 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:13.909222 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:13.909222 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:13.909222 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:13.909222 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:13.909222 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:13.909222 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:13.909222 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:13.909222 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:13.909222 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:13.909222 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:13.909222 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:13.909222 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:13.909222 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:13.909222 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:13.910158 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:13.910158 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:13.910158 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:13.910158 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:13.910158 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:13.910158 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:13.910158 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:13.910158 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:13.910158 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:13.910158 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:13.910158 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:13.910158 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:13.910158 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:13.910158 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:13.910158 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:13.910158 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:13.911341 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:13.911341 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:13.911341 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:13.911341 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:13.911341 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:13.911341 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:13.911341 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:13.911341 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:13.911341 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:13.911341 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:13.911341 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 12:27:13.911341 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:13.911341 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 147/289] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:27:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:13.916571 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725a07a-8f84-475c-a67a-cfecc010d7f4 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:13.975082 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:14.030107 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725a07a-8f84-475c-a67a-cfecc010d7f4 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:14.065683 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7833d5-2c4b-46d0-9273-7702cae8e3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:14.066285 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7833d5-2c4b-46d0-9273-7702cae8e3f0 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:14.066568 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7833d5-2c4b-46d0-9273-7702cae8e3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:14.066845 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7833d5-2c4b-46d0-9273-7702cae8e3f0 None admin] PATH_INFO: `/v3/roles` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:14.067557 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7833d5-2c4b-46d0-9273-7702cae8e3f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:14.067862 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7833d5-2c4b-46d0-9273-7702cae8e3f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:14.069242 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7833d5-2c4b-46d0-9273-7702cae8e3f0 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:14.077934 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 143/290] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jul 27 12:27:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:14.083682 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83051810-fc05-4559-919e-021c7184497f None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:14.178942 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:14.204346 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83051810-fc05-4559-919e-021c7184497f None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:14.243203 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c32386d-0a98-4596-86fa-120e527f05db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:14.243849 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32386d-0a98-4596-86fa-120e527f05db None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:14.244137 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32386d-0a98-4596-86fa-120e527f05db None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:14.244458 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32386d-0a98-4596-86fa-120e527f05db None admin] PATH_INFO: `/v3/users/65ae624a1b9042f4912ac9313fb85cf3` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:14.246110 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c32386d-0a98-4596-86fa-120e527f05db None admin] RBAC: Authorizing `identity:get_user(user_id=65ae624a1b9042f4912ac9313fb85cf3)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:14.248509 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c32386d-0a98-4596-86fa-120e527f05db None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:14.250469 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 148/291] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jul 27 12:27:14 2022] GET /identity/v3/users/65ae624a1b9042f4912ac9313fb85cf3 => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:14.256148 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7833d5-2c4b-46d0-9273-7702cae8e3f0 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:14.364955 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7833d5-2c4b-46d0-9273-7702cae8e3f0 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:14.378738 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:14.401379 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241d0be-0647-4698-b796-f7307c5ec48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:14.402030 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241d0be-0647-4698-b796-f7307c5ec48f None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:14.402322 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241d0be-0647-4698-b796-f7307c5ec48f None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:14.402601 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241d0be-0647-4698-b796-f7307c5ec48f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:14.475073 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241d0be-0647-4698-b796-f7307c5ec48f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:14.481729 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241d0be-0647-4698-b796-f7307c5ec48f None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:14.579351 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 144/292] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jul 27 12:27:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 12:27:14.585533 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c32386d-0a98-4596-86fa-120e527f05db None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:14.715048 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c32386d-0a98-4596-86fa-120e527f05db None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:14.756786 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41299c1-b660-4251-8257-96dede07663e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:14.757355 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41299c1-b660-4251-8257-96dede07663e None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:14.757662 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41299c1-b660-4251-8257-96dede07663e None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:14.757942 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41299c1-b660-4251-8257-96dede07663e None admin] PATH_INFO: `/v3/projects/252e28aa3a004a2c871b20abe82e81ee` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:14.759100 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41299c1-b660-4251-8257-96dede07663e None admin] RBAC: Authorizing `identity:get_project(project_id=252e28aa3a004a2c871b20abe82e81ee)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:14.760539 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41299c1-b660-4251-8257-96dede07663e None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:14.762519 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 149/293] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jul 27 12:27:14 2022] GET /identity/v3/projects/252e28aa3a004a2c871b20abe82e81ee => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:14.768858 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241d0be-0647-4698-b796-f7307c5ec48f None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:14.783869 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:14.872044 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241d0be-0647-4698-b796-f7307c5ec48f None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:14.907037 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565e94c-b60e-46b2-a26b-6c4012b5e7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:14.907706 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565e94c-b60e-46b2-a26b-6c4012b5e7a4 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:14.908501 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565e94c-b60e-46b2-a26b-6c4012b5e7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:14.908776 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565e94c-b60e-46b2-a26b-6c4012b5e7a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:14.909567 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565e94c-b60e-46b2-a26b-6c4012b5e7a4 None admin] RBAC: Adding query filter params (role.id=2136377433854360927c578b39f16e6f, scope.project.id=252e28aa3a004a2c871b20abe82e81ee, user.id=65ae624a1b9042f4912ac9313fb85cf3) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:14.909909 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565e94c-b60e-46b2-a26b-6c4012b5e7a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:14.911352 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565e94c-b60e-46b2-a26b-6c4012b5e7a4 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:14.917360 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 145/294] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jul 27 12:27:14 2022] GET /identity/v3/role_assignments?user.id=65ae624a1b9042f4912ac9313fb85cf3&scope.project.id=252e28aa3a004a2c871b20abe82e81ee&role.id=2136377433854360927c578b39f16e6f => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:15.306942 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345487a8-bd2b-479c-9064-83cf9d6f43e5 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:15.307308 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345487a8-bd2b-479c-9064-83cf9d6f43e5 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:15.307507 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345487a8-bd2b-479c-9064-83cf9d6f43e5 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:15.309126 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 150/295] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:15.314608 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c8a1f-194f-4ba0-8f7d-e3e4fea8cf43 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:15.314900 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c8a1f-194f-4ba0-8f7d-e3e4fea8cf43 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:15.315177 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c8a1f-194f-4ba0-8f7d-e3e4fea8cf43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:15.339145 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-f91c8a1f-194f-4ba0-8f7d-e3e4fea8cf43 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:15.340335 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-f91c8a1f-194f-4ba0-8f7d-e3e4fea8cf43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:15.424900 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 146/296] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:27:15.450675 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345487a8-bd2b-479c-9064-83cf9d6f43e5 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:15.473260 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:15.554081 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99e6bb-d27b-4d74-9ffb-5377ff3f1b74 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:15.554716 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99e6bb-d27b-4d74-9ffb-5377ff3f1b74 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:15.555207 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99e6bb-d27b-4d74-9ffb-5377ff3f1b74 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:15.557034 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 147/297] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 12:27:15.562421 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5c524-08d4-449a-b906-b9e8d3b83eb6 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:15.562919 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5c524-08d4-449a-b906-b9e8d3b83eb6 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:15.563371 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5c524-08d4-449a-b906-b9e8d3b83eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:15.572643 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345487a8-bd2b-479c-9064-83cf9d6f43e5 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:15.577857 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:15.584067 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-f9d5c524-08d4-449a-b906-b9e8d3b83eb6 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:15.585469 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-f9d5c524-08d4-449a-b906-b9e8d3b83eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:15.609369 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5256c0-8439-4668-8344-51392fe9abfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:15.610164 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5256c0-8439-4668-8344-51392fe9abfa None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:15.610455 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5256c0-8439-4668-8344-51392fe9abfa None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:15.611262 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5256c0-8439-4668-8344-51392fe9abfa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:15.622705 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5256c0-8439-4668-8344-51392fe9abfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:15.629156 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-3f5256c0-8439-4668-8344-51392fe9abfa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 12:27:15.629156 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:15.629156 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:15.629156 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:15.629156 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:15.629156 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:15.629156 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:15.629156 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:15.629156 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:15.629156 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:15.629156 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:15.629156 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:15.629156 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:15.629156 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:15.629156 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:15.629156 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:15.630075 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:15.630075 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:15.630075 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:15.630075 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:15.630075 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:15.630075 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:15.630075 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:15.630075 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:15.630075 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:15.630075 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:15.630075 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:15.630075 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:15.630075 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:15.630075 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:15.630075 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:15.630075 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:15.630880 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:15.630880 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:15.630880 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:15.630880 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:15.630880 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:15.630880 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:15.630880 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:15.630880 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:15.630880 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:15.630880 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:15.630880 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 12:27:15.630880 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:15.630880 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 151/298] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:27:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:15.636390 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5256c0-8439-4668-8344-51392fe9abfa None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:15.684366 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 148/299] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 12:27:15.684366 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1979ac-e2d2-4db2-89fb-4b6b9c269bea None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:15.684366 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1979ac-e2d2-4db2-89fb-4b6b9c269bea None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:15.684366 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1979ac-e2d2-4db2-89fb-4b6b9c269bea None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:15.684366 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 149/300] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:15.685739 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d3f95-ee9c-4243-ab54-f49d0adca5b2 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:15.686029 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d3f95-ee9c-4243-ab54-f49d0adca5b2 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:15.686308 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d3f95-ee9c-4243-ab54-f49d0adca5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:15.705485 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-550d3f95-ee9c-4243-ab54-f49d0adca5b2 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:15.706697 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-550d3f95-ee9c-4243-ab54-f49d0adca5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:15.745928 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:15.772709 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5256c0-8439-4668-8344-51392fe9abfa None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:15.776836 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 150/301] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 12:27:15.777523 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d3f95-ee9c-4243-ab54-f49d0adca5b2 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:15.820679 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3874cc-2ed1-4895-b6da-20defb33bbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:15.822194 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3874cc-2ed1-4895-b6da-20defb33bbff None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:15.822688 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3874cc-2ed1-4895-b6da-20defb33bbff None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:15.823678 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3874cc-2ed1-4895-b6da-20defb33bbff None admin] PATH_INFO: `/v3/roles` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:15.824547 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3874cc-2ed1-4895-b6da-20defb33bbff None admin] RBAC: Adding query filter params (name=reader) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:15.825320 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3874cc-2ed1-4895-b6da-20defb33bbff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:15.827321 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3874cc-2ed1-4895-b6da-20defb33bbff None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:15.838715 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 152/302] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jul 27 12:27:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:27:15.838715 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3874cc-2ed1-4895-b6da-20defb33bbff None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:15.853063 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:15.889040 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d3f95-ee9c-4243-ab54-f49d0adca5b2 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:15.923548 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ebbcc2-fc6b-4323-adab-583815d9a13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:15.924199 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ebbcc2-fc6b-4323-adab-583815d9a13a None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:15.924482 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ebbcc2-fc6b-4323-adab-583815d9a13a None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:15.924758 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ebbcc2-fc6b-4323-adab-583815d9a13a None admin] PATH_INFO: `/v3/roles/member` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:15.934992 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ebbcc2-fc6b-4323-adab-583815d9a13a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:15.940566 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-d9ebbcc2-fc6b-4323-adab-583815d9a13a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 12:27:15.940566 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:15.940566 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:15.940566 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:15.940566 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:15.940566 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:15.940566 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:15.940566 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:15.940566 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:15.940566 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:15.940566 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:15.940566 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:15.940566 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:15.940566 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:15.940566 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:15.940566 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:15.941462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:15.941462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:15.941462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:15.941462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:15.941462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:15.941462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:15.941462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:15.941462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:15.941462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:15.941462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:15.941462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:15.941462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:15.941462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:15.941462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:15.941462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:15.941462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:15.947146 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:15.947146 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:15.947146 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:15.947146 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:15.947146 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:15.947146 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:15.947146 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:15.947146 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:15.947146 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:15.947146 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:15.947146 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 12:27:15.947146 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:15.947146 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 151/303] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:27:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:15.947146 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ebbcc2-fc6b-4323-adab-583815d9a13a None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:15.954529 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3874cc-2ed1-4895-b6da-20defb33bbff None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:15.989918 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f364d2-de1a-411b-9f96-48b9d4a49839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:15.990916 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f364d2-de1a-411b-9f96-48b9d4a49839 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:15.991200 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f364d2-de1a-411b-9f96-48b9d4a49839 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:15.991477 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f364d2-de1a-411b-9f96-48b9d4a49839 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:15.992616 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f364d2-de1a-411b-9f96-48b9d4a49839 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:15.994121 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f364d2-de1a-411b-9f96-48b9d4a49839 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:16.000071 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 153/304] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:27:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:16.000071 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f364d2-de1a-411b-9f96-48b9d4a49839 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:16.007930 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:16.065742 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ebbcc2-fc6b-4323-adab-583815d9a13a None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:16.097203 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:16.107181 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f89c24-8c86-48c1-b384-ec232b45cf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:16.107812 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f89c24-8c86-48c1-b384-ec232b45cf14 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:16.108091 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f89c24-8c86-48c1-b384-ec232b45cf14 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:16.108362 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f89c24-8c86-48c1-b384-ec232b45cf14 None admin] PATH_INFO: `/v3/users/c9b595223d05459ba6f8efb1d7a99c03` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:16.109906 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f364d2-de1a-411b-9f96-48b9d4a49839 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:16.123251 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f89c24-8c86-48c1-b384-ec232b45cf14 None admin] RBAC: Authorizing `identity:get_user(user_id=c9b595223d05459ba6f8efb1d7a99c03)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:16.124882 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f89c24-8c86-48c1-b384-ec232b45cf14 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:16.131299 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 152/305] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jul 27 12:27:15 2022] GET /identity/v3/users/c9b595223d05459ba6f8efb1d7a99c03 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:16.131299 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f89c24-8c86-48c1-b384-ec232b45cf14 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:16.156160 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c5cd82-9243-410a-b2e8-6ce3d01fa340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:16.157345 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5cd82-9243-410a-b2e8-6ce3d01fa340 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:16.157884 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5cd82-9243-410a-b2e8-6ce3d01fa340 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:16.158168 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5cd82-9243-410a-b2e8-6ce3d01fa340 None admin] PATH_INFO: `/v3/roles` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:16.158905 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c5cd82-9243-410a-b2e8-6ce3d01fa340 None admin] RBAC: Adding query filter params (name=member) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:16.159215 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c5cd82-9243-410a-b2e8-6ce3d01fa340 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:16.160616 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c5cd82-9243-410a-b2e8-6ce3d01fa340 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:16.170690 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 154/306] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jul 27 12:27:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:16.171143 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c5cd82-9243-410a-b2e8-6ce3d01fa340 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:16.240904 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:16.250414 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f89c24-8c86-48c1-b384-ec232b45cf14 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:16.283133 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c5cd82-9243-410a-b2e8-6ce3d01fa340 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:16.288048 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1764d47-7dad-45ab-abf2-c974bf29e410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:16.288665 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1764d47-7dad-45ab-abf2-c974bf29e410 None admin] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:16.288946 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1764d47-7dad-45ab-abf2-c974bf29e410 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:16.289218 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1764d47-7dad-45ab-abf2-c974bf29e410 None admin] PATH_INFO: `/v3/groups` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:16.289907 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1764d47-7dad-45ab-abf2-c974bf29e410 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:16.291337 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1764d47-7dad-45ab-abf2-c974bf29e410 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:16.309718 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 153/307] 10.222.0.55 () {60 vars in 1134 bytes} [Wed Jul 27 12:27:16 2022] POST /identity/v3/groups => generated 229 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 12:27:16.309718 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1764d47-7dad-45ab-abf2-c974bf29e410 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:16.330216 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff25da6-9e9f-438c-9709-f7779ee8d069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:16.330555 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff25da6-9e9f-438c-9709-f7779ee8d069 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:16.330814 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff25da6-9e9f-438c-9709-f7779ee8d069 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:16.331089 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff25da6-9e9f-438c-9709-f7779ee8d069 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:16.332106 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff25da6-9e9f-438c-9709-f7779ee8d069 None admin] RBAC: Adding query filter params (role.id=dc674f0d3e424f7baef5700ad3f7ff65, user.id=c9b595223d05459ba6f8efb1d7a99c03, scope.system=all) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:16.332360 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff25da6-9e9f-438c-9709-f7779ee8d069 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:16.333882 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff25da6-9e9f-438c-9709-f7779ee8d069 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:16.340670 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 155/308] 10.222.0.55 () {56 vars in 1308 bytes} [Wed Jul 27 12:27:16 2022] GET /identity/v3/role_assignments?user.id=c9b595223d05459ba6f8efb1d7a99c03&scope.system=all&role.id=dc674f0d3e424f7baef5700ad3f7ff65 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:16.366629 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:16.394413 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1403a-f3fd-475f-a1ff-903b87cc7f82 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:16.394863 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1403a-f3fd-475f-a1ff-903b87cc7f82 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:16.395331 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1403a-f3fd-475f-a1ff-903b87cc7f82 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:16.397885 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 156/309] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:16.403408 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a3aa1-3d12-4f1b-94fe-aa8ebc13d827 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:16.403861 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a3aa1-3d12-4f1b-94fe-aa8ebc13d827 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:16.404224 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a3aa1-3d12-4f1b-94fe-aa8ebc13d827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:16.432472 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-389a3aa1-3d12-4f1b-94fe-aa8ebc13d827 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:16.434334 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-389a3aa1-3d12-4f1b-94fe-aa8ebc13d827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:16.438648 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1764d47-7dad-45ab-abf2-c974bf29e410 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:16.484370 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9660a-17e7-4d22-9dbe-afa198f952d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:16.491279 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9660a-17e7-4d22-9dbe-afa198f952d7 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:16.491878 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9660a-17e7-4d22-9dbe-afa198f952d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:16.492337 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9660a-17e7-4d22-9dbe-afa198f952d7 None admin] PATH_INFO: `/v3/users/58bc697b590345558b566620ed1b0908` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:16.494084 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad9660a-17e7-4d22-9dbe-afa198f952d7 None admin] RBAC: Authorizing `identity:get_user(user_id=58bc697b590345558b566620ed1b0908)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:16.495817 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad9660a-17e7-4d22-9dbe-afa198f952d7 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:16.501929 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 154/310] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jul 27 12:27:16 2022] GET /identity/v3/users/58bc697b590345558b566620ed1b0908 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:16.505417 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9660a-17e7-4d22-9dbe-afa198f952d7 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:16.536719 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 157/311] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:27:16.559501 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a3aa1-3d12-4f1b-94fe-aa8ebc13d827 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:16.634878 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9660a-17e7-4d22-9dbe-afa198f952d7 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:16.636701 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:16.653776 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:16.683712 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e51251-644c-428a-8bcb-7fe627742dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:16.684836 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e51251-644c-428a-8bcb-7fe627742dcd None admin] REQUEST_METHOD: `PUT` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:16.685075 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a3aa1-3d12-4f1b-94fe-aa8ebc13d827 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:16.685556 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e51251-644c-428a-8bcb-7fe627742dcd None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:16.686069 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e51251-644c-428a-8bcb-7fe627742dcd None admin] PATH_INFO: `/v3/system/users/58bc697b590345558b566620ed1b0908/roles/2136377433854360927c578b39f16e6f` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:16.687893 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e51251-644c-428a-8bcb-7fe627742dcd None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=58bc697b590345558b566620ed1b0908, role_id=2136377433854360927c578b39f16e6f)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:16.690365 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e51251-644c-428a-8bcb-7fe627742dcd None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:16.702421 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 155/312] 10.222.0.55 () {58 vars in 1334 bytes} [Wed Jul 27 12:27:16 2022] PUT /identity/v3/system/users/58bc697b590345558b566620ed1b0908/roles/2136377433854360927c578b39f16e6f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 12:27:16.742201 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d37dc-5bb7-4280-9458-61123a485d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:16.743274 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d37dc-5bb7-4280-9458-61123a485d23 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:16.743758 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d37dc-5bb7-4280-9458-61123a485d23 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:16.744235 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d37dc-5bb7-4280-9458-61123a485d23 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:16.757676 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d37dc-5bb7-4280-9458-61123a485d23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:16.763915 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-172d37dc-5bb7-4280-9458-61123a485d23 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 12:27:16.763915 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:16.763915 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:16.763915 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:16.763915 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:16.763915 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:16.763915 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:16.763915 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:16.763915 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:16.763915 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:16.763915 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:16.763915 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:16.763915 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:16.763915 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:16.763915 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:16.763915 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:16.764850 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:16.764850 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:16.764850 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:16.764850 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:16.764850 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:16.764850 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:16.764850 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:16.764850 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:16.764850 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:16.764850 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:16.764850 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:16.764850 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:16.764850 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:16.764850 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:16.764850 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:16.764850 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:16.765697 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:16.765697 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:16.765697 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:16.765697 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:16.765697 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:16.765697 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:16.765697 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:16.765697 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:16.765697 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:16.765697 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:16.765697 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 12:27:16.765697 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:16.768834 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 158/313] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:27:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 12:27:16.775304 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e51251-644c-428a-8bcb-7fe627742dcd None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:16.895943 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e51251-644c-428a-8bcb-7fe627742dcd None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:16.933975 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27eebb-45e7-4628-83ba-40cb7a229e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:16.934609 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27eebb-45e7-4628-83ba-40cb7a229e07 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:16.934895 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27eebb-45e7-4628-83ba-40cb7a229e07 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:16.935176 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27eebb-45e7-4628-83ba-40cb7a229e07 None admin] PATH_INFO: `/v3/roles` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:16.935905 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f27eebb-45e7-4628-83ba-40cb7a229e07 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:16.936213 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f27eebb-45e7-4628-83ba-40cb7a229e07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:16.937620 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f27eebb-45e7-4628-83ba-40cb7a229e07 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:16.947743 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 156/314] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jul 27 12:27:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:16.953118 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d37dc-5bb7-4280-9458-61123a485d23 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:17.062169 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d37dc-5bb7-4280-9458-61123a485d23 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:17.086665 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:17.100104 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ce85d-a4bc-402b-b184-d74082d342a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:17.100755 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ce85d-a4bc-402b-b184-d74082d342a2 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:17.101038 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ce85d-a4bc-402b-b184-d74082d342a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:17.101314 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ce85d-a4bc-402b-b184-d74082d342a2 None admin] PATH_INFO: `/v3/users/2a507f8f7b3643dcbf9a75667db7baea` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:17.102530 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ce85d-a4bc-402b-b184-d74082d342a2 None admin] RBAC: Authorizing `identity:get_user(user_id=2a507f8f7b3643dcbf9a75667db7baea)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:17.104047 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ce85d-a4bc-402b-b184-d74082d342a2 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:17.106053 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 159/315] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jul 27 12:27:16 2022] GET /identity/v3/users/2a507f8f7b3643dcbf9a75667db7baea => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:17.111895 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27eebb-45e7-4628-83ba-40cb7a229e07 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:17.154519 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:17.232853 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27eebb-45e7-4628-83ba-40cb7a229e07 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:17.271041 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fea3a1-9476-4f95-ae9d-2b23490a1519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:17.271667 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fea3a1-9476-4f95-ae9d-2b23490a1519 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:17.271952 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fea3a1-9476-4f95-ae9d-2b23490a1519 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:17.272232 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fea3a1-9476-4f95-ae9d-2b23490a1519 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:17.342724 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fea3a1-9476-4f95-ae9d-2b23490a1519 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:17.344187 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fea3a1-9476-4f95-ae9d-2b23490a1519 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:17.384219 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:17.447916 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 157/316] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jul 27 12:27:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 12:27:17.453256 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ce85d-a4bc-402b-b184-d74082d342a2 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:17.573265 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ce85d-a4bc-402b-b184-d74082d342a2 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:17.611749 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f6fedf-ab6f-487d-b13a-b7a42a8303d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:17.612409 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6fedf-ab6f-487d-b13a-b7a42a8303d5 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:17.612693 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6fedf-ab6f-487d-b13a-b7a42a8303d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:17.612974 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6fedf-ab6f-487d-b13a-b7a42a8303d5 None admin] PATH_INFO: `/v3/projects/252e28aa3a004a2c871b20abe82e81ee` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:17.614170 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f6fedf-ab6f-487d-b13a-b7a42a8303d5 None admin] RBAC: Authorizing `identity:get_project(project_id=252e28aa3a004a2c871b20abe82e81ee)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:17.615899 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f6fedf-ab6f-487d-b13a-b7a42a8303d5 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:17.618015 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 160/317] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jul 27 12:27:17 2022] GET /identity/v3/projects/252e28aa3a004a2c871b20abe82e81ee => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:17.624349 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fea3a1-9476-4f95-ae9d-2b23490a1519 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:17.733398 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fea3a1-9476-4f95-ae9d-2b23490a1519 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:17.770311 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21ec98-d821-4dd5-bf8b-c71cd90a47a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:17.770936 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21ec98-d821-4dd5-bf8b-c71cd90a47a1 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:17.771225 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21ec98-d821-4dd5-bf8b-c71cd90a47a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:17.771507 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21ec98-d821-4dd5-bf8b-c71cd90a47a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:17.772301 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21ec98-d821-4dd5-bf8b-c71cd90a47a1 None admin] RBAC: Adding query filter params (role.id=dc674f0d3e424f7baef5700ad3f7ff65, scope.project.id=252e28aa3a004a2c871b20abe82e81ee, user.id=2a507f8f7b3643dcbf9a75667db7baea) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:17.772617 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21ec98-d821-4dd5-bf8b-c71cd90a47a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:17.774081 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21ec98-d821-4dd5-bf8b-c71cd90a47a1 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:17.780269 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 158/318] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jul 27 12:27:17 2022] GET /identity/v3/role_assignments?user.id=2a507f8f7b3643dcbf9a75667db7baea&scope.project.id=252e28aa3a004a2c871b20abe82e81ee&role.id=dc674f0d3e424f7baef5700ad3f7ff65 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:18.699009 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8cd04-a676-478a-af9e-462a9d670cea None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:18.699429 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8cd04-a676-478a-af9e-462a9d670cea None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:18.699552 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8cd04-a676-478a-af9e-462a9d670cea None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:18.701056 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 161/319] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:18.706232 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26354fa0-85ec-4b36-afa3-c9d676785a5b None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:18.706624 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26354fa0-85ec-4b36-afa3-c9d676785a5b None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:18.706786 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26354fa0-85ec-4b36-afa3-c9d676785a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:18.713203 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:18.726738 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-26354fa0-85ec-4b36-afa3-c9d676785a5b None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:18.727915 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-26354fa0-85ec-4b36-afa3-c9d676785a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:18.781338 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fac36f-3086-40cc-ac95-e3a84cd6ad3d None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:18.782006 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fac36f-3086-40cc-ac95-e3a84cd6ad3d None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:18.782997 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fac36f-3086-40cc-ac95-e3a84cd6ad3d None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:18.785617 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 162/320] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:18.790972 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb75f2-0d7b-4e04-91c0-a2795a5c6b64 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:18.791546 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb75f2-0d7b-4e04-91c0-a2795a5c6b64 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:18.792047 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb75f2-0d7b-4e04-91c0-a2795a5c6b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:18.797686 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 159/321] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:27:18.812576 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-b6bb75f2-0d7b-4e04-91c0-a2795a5c6b64 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:18.814219 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-b6bb75f2-0d7b-4e04-91c0-a2795a5c6b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:18.821045 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26354fa0-85ec-4b36-afa3-c9d676785a5b None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:18.880998 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:18.905868 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 163/322] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:27:18.920513 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb75f2-0d7b-4e04-91c0-a2795a5c6b64 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:18.941827 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26354fa0-85ec-4b36-afa3-c9d676785a5b None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:18.973108 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:18.980030 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1545eed-1fc3-4b50-a277-abc958cabbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:18.980673 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1545eed-1fc3-4b50-a277-abc958cabbab None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:18.980965 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1545eed-1fc3-4b50-a277-abc958cabbab None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:18.981244 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1545eed-1fc3-4b50-a277-abc958cabbab None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:18.992709 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1545eed-1fc3-4b50-a277-abc958cabbab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:18.997793 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-e1545eed-1fc3-4b50-a277-abc958cabbab None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 12:27:18.997793 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:18.997793 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:18.997793 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:18.997793 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:18.997793 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:18.997793 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:18.997793 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:18.997793 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:18.997793 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:18.997793 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:18.997793 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:18.997793 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:18.997793 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:18.997793 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:18.997793 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:18.998677 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:18.998677 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:18.998677 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:18.998677 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:18.998677 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:18.998677 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:18.998677 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:18.998677 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:18.998677 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:18.998677 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:18.998677 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:18.998677 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:18.998677 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:18.998677 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:18.998677 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:18.998677 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:18.999506 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:18.999506 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:18.999506 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:18.999506 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:18.999506 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:18.999506 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:18.999506 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:18.999506 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:18.999506 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:18.999506 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:18.999506 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 12:27:18.999506 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:18.999506 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 160/323] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:27:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 12:27:19.002913 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ddd77e-88ee-4a80-8c5f-36280f485660 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:19.003196 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ddd77e-88ee-4a80-8c5f-36280f485660 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:19.004640 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ddd77e-88ee-4a80-8c5f-36280f485660 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:19.005959 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 161/324] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:19.006655 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ddd77e-88ee-4a80-8c5f-36280f485660 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:19.032027 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb75f2-0d7b-4e04-91c0-a2795a5c6b64 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:19.066842 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d6a35-b6c7-4e4c-a098-05296c797c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:19.067483 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d6a35-b6c7-4e4c-a098-05296c797c12 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:19.067766 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d6a35-b6c7-4e4c-a098-05296c797c12 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:19.068041 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d6a35-b6c7-4e4c-a098-05296c797c12 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:19.069199 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627d6a35-b6c7-4e4c-a098-05296c797c12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:19.070671 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627d6a35-b6c7-4e4c-a098-05296c797c12 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:19.072248 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 164/325] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:27:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:27:19.073352 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730ea2c-4f07-40f8-874c-77e4bfdbbe52 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:19.073657 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730ea2c-4f07-40f8-874c-77e4bfdbbe52 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:19.073939 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730ea2c-4f07-40f8-874c-77e4bfdbbe52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:19.091342 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-d730ea2c-4f07-40f8-874c-77e4bfdbbe52 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:19.092506 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-d730ea2c-4f07-40f8-874c-77e4bfdbbe52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:19.106554 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ddd77e-88ee-4a80-8c5f-36280f485660 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:19.138852 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3545c0-fa5c-4b90-a662-9ab82413bcc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:19.139459 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3545c0-fa5c-4b90-a662-9ab82413bcc3 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:19.139737 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3545c0-fa5c-4b90-a662-9ab82413bcc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:19.140018 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3545c0-fa5c-4b90-a662-9ab82413bcc3 None admin] PATH_INFO: `/v3/roles` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:19.140720 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3545c0-fa5c-4b90-a662-9ab82413bcc3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:19.141021 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3545c0-fa5c-4b90-a662-9ab82413bcc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:19.141405 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:19.143407 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3545c0-fa5c-4b90-a662-9ab82413bcc3 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:19.156049 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 162/326] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jul 27 12:27:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:19.156877 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3545c0-fa5c-4b90-a662-9ab82413bcc3 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:19.166505 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 165/327] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:27:19.167366 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730ea2c-4f07-40f8-874c-77e4bfdbbe52 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:19.219597 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:19.264640 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3545c0-fa5c-4b90-a662-9ab82413bcc3 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:19.273454 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730ea2c-4f07-40f8-874c-77e4bfdbbe52 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:19.297893 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55562473-83e8-4214-8944-2013a1e40ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:19.298544 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55562473-83e8-4214-8944-2013a1e40ba4 None admin] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:19.298825 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55562473-83e8-4214-8944-2013a1e40ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:19.299095 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55562473-83e8-4214-8944-2013a1e40ba4 None admin] PATH_INFO: `/v3/groups` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:19.299745 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55562473-83e8-4214-8944-2013a1e40ba4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:19.301168 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55562473-83e8-4214-8944-2013a1e40ba4 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:19.307613 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbcffd3-1f25-460f-bcf3-2360ec88e25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:19.308393 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcffd3-1f25-460f-bcf3-2360ec88e25c None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:19.308724 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcffd3-1f25-460f-bcf3-2360ec88e25c None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:19.309042 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcffd3-1f25-460f-bcf3-2360ec88e25c None admin] PATH_INFO: `/v3/users/c9b595223d05459ba6f8efb1d7a99c03` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:19.310557 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbcffd3-1f25-460f-bcf3-2360ec88e25c None admin] RBAC: Authorizing `identity:get_user(user_id=c9b595223d05459ba6f8efb1d7a99c03)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:19.312137 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbcffd3-1f25-460f-bcf3-2360ec88e25c None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:19.313800 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 166/328] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jul 27 12:27:19 2022] GET /identity/v3/users/c9b595223d05459ba6f8efb1d7a99c03 => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:19.314570 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbcffd3-1f25-460f-bcf3-2360ec88e25c None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:19.329850 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 163/329] 10.222.0.55 () {60 vars in 1134 bytes} [Wed Jul 27 12:27:19 2022] POST /identity/v3/groups => generated 226 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 12:27:19.329850 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55562473-83e8-4214-8944-2013a1e40ba4 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:19.379071 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:19.428966 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbcffd3-1f25-460f-bcf3-2360ec88e25c None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:19.441696 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55562473-83e8-4214-8944-2013a1e40ba4 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:19.457645 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:19.468770 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd3d29-2289-45e0-9942-c773370e54e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:19.469445 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd3d29-2289-45e0-9942-c773370e54e8 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:19.469817 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd3d29-2289-45e0-9942-c773370e54e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:19.470077 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd3d29-2289-45e0-9942-c773370e54e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:19.481197 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cbeb11-2ba8-4dd8-b0b4-7bd8efb146f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:19.481435 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd3d29-2289-45e0-9942-c773370e54e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:19.481907 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cbeb11-2ba8-4dd8-b0b4-7bd8efb146f6 None admin] REQUEST_METHOD: `PUT` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:19.482193 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cbeb11-2ba8-4dd8-b0b4-7bd8efb146f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:19.482473 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cbeb11-2ba8-4dd8-b0b4-7bd8efb146f6 None admin] PATH_INFO: `/v3/system/users/c9b595223d05459ba6f8efb1d7a99c03/roles/dc674f0d3e424f7baef5700ad3f7ff65` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:19.483954 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cbeb11-2ba8-4dd8-b0b4-7bd8efb146f6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c9b595223d05459ba6f8efb1d7a99c03, role_id=dc674f0d3e424f7baef5700ad3f7ff65)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:19.485617 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cbeb11-2ba8-4dd8-b0b4-7bd8efb146f6 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:19.486485 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-eebd3d29-2289-45e0-9942-c773370e54e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 12:27:19.486485 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:19.486485 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:19.486485 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:19.486485 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:19.486485 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:19.486485 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:19.486485 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:19.486485 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:19.486485 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:19.486485 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:19.486485 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:19.486485 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:19.486485 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:19.486485 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:19.486485 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:19.487403 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:19.487403 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:19.487403 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:19.487403 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:19.487403 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:19.487403 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:19.487403 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:19.487403 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:19.487403 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:19.487403 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:19.487403 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:19.487403 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:19.487403 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:19.487403 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:19.487403 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:19.487403 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:19.488246 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:19.488246 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:19.488246 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:19.488246 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:19.488246 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:19.488246 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:19.488246 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:19.488246 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:19.488246 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:19.488246 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:19.488246 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 12:27:19.488246 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:19.488246 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 167/330] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:27:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:19.494080 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd3d29-2289-45e0-9942-c773370e54e8 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:19.496331 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 164/331] 10.222.0.55 () {58 vars in 1334 bytes} [Wed Jul 27 12:27:19 2022] PUT /identity/v3/system/users/c9b595223d05459ba6f8efb1d7a99c03/roles/dc674f0d3e424f7baef5700ad3f7ff65 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 12:27:19.624489 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd3d29-2289-45e0-9942-c773370e54e8 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:19.643796 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:19.668300 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83f57e-e57e-4d55-97c2-83d08638d4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:19.668944 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83f57e-e57e-4d55-97c2-83d08638d4fd None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:19.669219 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83f57e-e57e-4d55-97c2-83d08638d4fd None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:19.669491 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83f57e-e57e-4d55-97c2-83d08638d4fd None admin] PATH_INFO: `/v3/roles` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:19.670244 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83f57e-e57e-4d55-97c2-83d08638d4fd None admin] RBAC: Adding query filter params (name=member) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:19.670545 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83f57e-e57e-4d55-97c2-83d08638d4fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:19.671926 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83f57e-e57e-4d55-97c2-83d08638d4fd None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:19.682087 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 168/332] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jul 27 12:27:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:27:19.688497 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cbeb11-2ba8-4dd8-b0b4-7bd8efb146f6 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:19.800098 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cbeb11-2ba8-4dd8-b0b4-7bd8efb146f6 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:19.838667 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217820f8-9d41-4fe0-9990-239aed1c2cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:19.839692 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217820f8-9d41-4fe0-9990-239aed1c2cd4 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:19.840200 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217820f8-9d41-4fe0-9990-239aed1c2cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:19.840700 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217820f8-9d41-4fe0-9990-239aed1c2cd4 None admin] PATH_INFO: `/v3/users/58bc697b590345558b566620ed1b0908` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:19.842139 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217820f8-9d41-4fe0-9990-239aed1c2cd4 None admin] RBAC: Authorizing `identity:get_user(user_id=58bc697b590345558b566620ed1b0908)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:19.843787 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217820f8-9d41-4fe0-9990-239aed1c2cd4 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:19.846490 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 165/333] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jul 27 12:27:19 2022] GET /identity/v3/users/58bc697b590345558b566620ed1b0908 => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:19.852331 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83f57e-e57e-4d55-97c2-83d08638d4fd None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:19.964509 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83f57e-e57e-4d55-97c2-83d08638d4fd None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:20.002215 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d301bec-42d9-440b-9a97-ba68842fe8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:20.002839 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d301bec-42d9-440b-9a97-ba68842fe8c9 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:20.003124 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d301bec-42d9-440b-9a97-ba68842fe8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:20.003400 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d301bec-42d9-440b-9a97-ba68842fe8c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:20.004202 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d301bec-42d9-440b-9a97-ba68842fe8c9 None admin] RBAC: Adding query filter params (role.id=2136377433854360927c578b39f16e6f, user.id=58bc697b590345558b566620ed1b0908, scope.system=all) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:20.004513 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d301bec-42d9-440b-9a97-ba68842fe8c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:20.005984 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d301bec-42d9-440b-9a97-ba68842fe8c9 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:20.019101 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 169/334] 10.222.0.55 () {56 vars in 1308 bytes} [Wed Jul 27 12:27:19 2022] GET /identity/v3/role_assignments?user.id=58bc697b590345558b566620ed1b0908&scope.system=all&role.id=2136377433854360927c578b39f16e6f => generated 510 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:21.852022 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec1675-1855-412b-b9dd-4c8786f9f425 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:21.853043 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec1675-1855-412b-b9dd-4c8786f9f425 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:21.853541 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec1675-1855-412b-b9dd-4c8786f9f425 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:21.855399 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 166/335] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:21.860567 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72755904-4f79-4975-80e2-658a00a54b25 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:21.861379 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72755904-4f79-4975-80e2-658a00a54b25 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:21.861886 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72755904-4f79-4975-80e2-658a00a54b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:21.886191 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-72755904-4f79-4975-80e2-658a00a54b25 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:21.887711 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-72755904-4f79-4975-80e2-658a00a54b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:21.919649 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:21.939647 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e55b8-130a-422a-b261-18eb29c49a06 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:21.939937 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e55b8-130a-422a-b261-18eb29c49a06 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:21.940320 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e55b8-130a-422a-b261-18eb29c49a06 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:21.946082 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 167/336] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:21.947986 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c2316-73db-40dc-b026-1cadd9a9c11c None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:21.948270 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c2316-73db-40dc-b026-1cadd9a9c11c None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:21.948558 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c2316-73db-40dc-b026-1cadd9a9c11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:21.980475 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-d37c2316-73db-40dc-b026-1cadd9a9c11c None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:21.981712 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-d37c2316-73db-40dc-b026-1cadd9a9c11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:21.991176 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 170/337] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:27:22.016530 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72755904-4f79-4975-80e2-658a00a54b25 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:22.057736 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:22.095638 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 168/338] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:27:22.142609 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c2316-73db-40dc-b026-1cadd9a9c11c None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:22.171513 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72755904-4f79-4975-80e2-658a00a54b25 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:22.249833 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f4b1b-6dd9-44dc-96e7-86f3d32a22bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:22.250720 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f4b1b-6dd9-44dc-96e7-86f3d32a22bd None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:22.251046 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f4b1b-6dd9-44dc-96e7-86f3d32a22bd None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:22.252000 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f4b1b-6dd9-44dc-96e7-86f3d32a22bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:22.278386 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f4b1b-6dd9-44dc-96e7-86f3d32a22bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:22.285030 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-e47f4b1b-6dd9-44dc-96e7-86f3d32a22bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 12:27:22.285030 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:22.285030 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:22.285030 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:22.285030 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:22.285030 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:22.285030 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:22.285030 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:22.285030 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:22.285030 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:22.285030 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:22.285030 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:22.285030 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:22.285030 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:22.285030 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:22.285030 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:22.285959 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:22.285959 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:22.285959 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:22.285959 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:22.285959 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:22.285959 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:22.285959 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:22.285959 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:22.285959 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:22.285959 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:22.285959 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:22.285959 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:22.285959 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:22.285959 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:22.285959 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:22.285959 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:22.286773 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:22.286773 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:22.286773 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:22.286773 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:22.286773 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:22.286773 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:22.286773 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:22.286773 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:22.286773 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:22.286773 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:22.286773 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 12:27:22.286773 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:22.286773 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 171/339] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:27:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 12:27:22.295756 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f4b1b-6dd9-44dc-96e7-86f3d32a22bd None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:22.329081 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c2316-73db-40dc-b026-1cadd9a9c11c None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:22.344870 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:22.395533 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdebc43c-2016-439b-8c98-a57fbd92330a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:22.396193 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebc43c-2016-439b-8c98-a57fbd92330a None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:22.396472 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebc43c-2016-439b-8c98-a57fbd92330a None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:22.397205 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebc43c-2016-439b-8c98-a57fbd92330a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:22.418097 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdebc43c-2016-439b-8c98-a57fbd92330a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:22.424180 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-bdebc43c-2016-439b-8c98-a57fbd92330a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 12:27:22.424180 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:22.424180 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:22.424180 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:22.424180 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:22.424180 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:22.424180 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:22.424180 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:22.424180 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:22.424180 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:22.424180 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:22.424180 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:22.424180 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:22.424180 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:22.424180 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:22.424180 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:22.425087 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:22.425087 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:22.425087 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:22.425087 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:22.425087 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:22.425087 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:22.425087 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:22.425087 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:22.425087 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:22.425087 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:22.425087 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:22.425087 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:22.425087 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:22.425087 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:22.425087 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:22.425087 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:22.425952 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:22.425952 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:22.425952 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:22.425952 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:22.425952 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:22.425952 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:22.425952 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:22.425952 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:22.425952 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:22.425952 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:22.425952 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 12:27:22.425952 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:22.425952 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 169/340] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:27:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 12:27:22.431598 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdebc43c-2016-439b-8c98-a57fbd92330a None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:22.509703 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:22.512654 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f4b1b-6dd9-44dc-96e7-86f3d32a22bd None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:22.577349 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a58cc-e1d9-4d1a-9b19-f6d2df0ca7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:22.578027 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a58cc-e1d9-4d1a-9b19-f6d2df0ca7d3 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:22.578311 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a58cc-e1d9-4d1a-9b19-f6d2df0ca7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:22.578590 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a58cc-e1d9-4d1a-9b19-f6d2df0ca7d3 None admin] PATH_INFO: `/v3/roles` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:22.579357 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641a58cc-e1d9-4d1a-9b19-f6d2df0ca7d3 None admin] RBAC: Adding query filter params (name=member) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:22.579670 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641a58cc-e1d9-4d1a-9b19-f6d2df0ca7d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:22.581066 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641a58cc-e1d9-4d1a-9b19-f6d2df0ca7d3 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:22.597533 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 172/341] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jul 27 12:27:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:27:22.598530 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdebc43c-2016-439b-8c98-a57fbd92330a None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:22.608089 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a58cc-e1d9-4d1a-9b19-f6d2df0ca7d3 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:22.671002 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51ac9c-0c34-4b4c-93fc-e3dc802b2e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:22.671645 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51ac9c-0c34-4b4c-93fc-e3dc802b2e7e None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:22.672043 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51ac9c-0c34-4b4c-93fc-e3dc802b2e7e None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:22.672330 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51ac9c-0c34-4b4c-93fc-e3dc802b2e7e None admin] PATH_INFO: `/v3/roles` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:22.673139 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51ac9c-0c34-4b4c-93fc-e3dc802b2e7e None admin] RBAC: Adding query filter params (name=reader) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:22.673971 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51ac9c-0c34-4b4c-93fc-e3dc802b2e7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:22.675605 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51ac9c-0c34-4b4c-93fc-e3dc802b2e7e None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:22.700928 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 170/342] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jul 27 12:27:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:27:22.703139 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e3f91-605e-4224-9fb2-855b8ce6ad67 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:22.703426 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e3f91-605e-4224-9fb2-855b8ce6ad67 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:22.703699 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e3f91-605e-4224-9fb2-855b8ce6ad67 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:22.704971 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 171/343] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:22.711521 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cc49b-3e49-41b7-b24c-cb491209c854 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:22.711807 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cc49b-3e49-41b7-b24c-cb491209c854 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:22.712082 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cc49b-3e49-41b7-b24c-cb491209c854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:22.743161 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-621cc49b-3e49-41b7-b24c-cb491209c854 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:22.744840 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-621cc49b-3e49-41b7-b24c-cb491209c854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:22.790228 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:22.821673 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a58cc-e1d9-4d1a-9b19-f6d2df0ca7d3 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:22.868801 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 172/344] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:27:22.870357 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621cc49b-3e49-41b7-b24c-cb491209c854 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:22.885621 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793832ec-2f3b-4d0b-82b6-2370f713aa4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:22.885621 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793832ec-2f3b-4d0b-82b6-2370f713aa4c None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:22.885621 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793832ec-2f3b-4d0b-82b6-2370f713aa4c None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:22.885621 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793832ec-2f3b-4d0b-82b6-2370f713aa4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:22.915223 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:22.958942 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793832ec-2f3b-4d0b-82b6-2370f713aa4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:22.960427 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793832ec-2f3b-4d0b-82b6-2370f713aa4c None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:23.021032 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621cc49b-3e49-41b7-b24c-cb491209c854 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:23.064616 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ff413-dc9f-4268-8ba3-61cc09766e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:23.065665 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ff413-dc9f-4268-8ba3-61cc09766e22 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:23.066151 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ff413-dc9f-4268-8ba3-61cc09766e22 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:23.066637 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ff413-dc9f-4268-8ba3-61cc09766e22 None admin] PATH_INFO: `/v3/users/c9b595223d05459ba6f8efb1d7a99c03` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:23.068046 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ff413-dc9f-4268-8ba3-61cc09766e22 None admin] RBAC: Authorizing `identity:get_user(user_id=c9b595223d05459ba6f8efb1d7a99c03)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:23.069757 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ff413-dc9f-4268-8ba3-61cc09766e22 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:23.071911 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 173/345] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Jul 27 12:27:22 2022] GET /identity/v3/users/c9b595223d05459ba6f8efb1d7a99c03 => generated 293 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:23.072896 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ff413-dc9f-4268-8ba3-61cc09766e22 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:23.076026 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:23.091036 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 173/346] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jul 27 12:27:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 12:27:23.091217 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793832ec-2f3b-4d0b-82b6-2370f713aa4c None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:23.184690 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ff413-dc9f-4268-8ba3-61cc09766e22 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:23.187983 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:23.209960 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793832ec-2f3b-4d0b-82b6-2370f713aa4c None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:23.239330 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c529d-6a57-4360-b938-02483c60abbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:23.240380 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c529d-6a57-4360-b938-02483c60abbc None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:23.241126 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c529d-6a57-4360-b938-02483c60abbc None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:23.241635 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c529d-6a57-4360-b938-02483c60abbc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:23.247475 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2035078-af05-4338-a8cf-aa88dc8d560b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:23.248107 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2035078-af05-4338-a8cf-aa88dc8d560b None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:23.248388 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2035078-af05-4338-a8cf-aa88dc8d560b None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:23.248668 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2035078-af05-4338-a8cf-aa88dc8d560b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:23.249460 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2035078-af05-4338-a8cf-aa88dc8d560b None admin] RBAC: Adding query filter params (role.id=dc674f0d3e424f7baef5700ad3f7ff65, user.id=c9b595223d05459ba6f8efb1d7a99c03, scope.system=all) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:23.250840 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2035078-af05-4338-a8cf-aa88dc8d560b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:23.252976 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2035078-af05-4338-a8cf-aa88dc8d560b None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:23.256336 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c529d-6a57-4360-b938-02483c60abbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:23.262203 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-169c529d-6a57-4360-b938-02483c60abbc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 12:27:23.262203 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:23.262203 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:23.262203 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:23.262203 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:23.262203 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:23.262203 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:23.262203 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:23.262203 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:23.262203 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:23.262203 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:23.262203 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:23.262203 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:23.262203 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:23.262203 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:23.262203 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:23.263110 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:23.263110 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:23.263110 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:23.263110 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:23.263110 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:23.263110 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:23.263110 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:23.263110 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:23.263110 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:23.263110 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:23.263110 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:23.263110 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:23.263110 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:23.263110 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:23.263110 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:23.263110 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:23.263999 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:23.263999 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:23.263999 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:23.263999 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:23.263999 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:23.263999 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:23.263999 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:23.263999 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:23.263999 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:23.263999 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:23.263999 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 12:27:23.263999 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:23.265566 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 174/347] 10.222.0.55 () {56 vars in 1308 bytes} [Wed Jul 27 12:27:23 2022] GET /identity/v3/role_assignments?user.id=c9b595223d05459ba6f8efb1d7a99c03&scope.system=all&role.id=dc674f0d3e424f7baef5700ad3f7ff65 => generated 510 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:23.266554 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 174/348] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jul 27 12:27:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:23.267851 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2035078-af05-4338-a8cf-aa88dc8d560b None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:23.268814 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8e3f7-7f26-48b0-80f5-47817e2f1453 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:23.269297 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8e3f7-7f26-48b0-80f5-47817e2f1453 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:23.269805 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8e3f7-7f26-48b0-80f5-47817e2f1453 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:23.271403 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 175/349] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:23.279458 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9826af2-4e19-46e1-9e73-44719a06876a None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:23.280057 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9826af2-4e19-46e1-9e73-44719a06876a None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:23.280556 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9826af2-4e19-46e1-9e73-44719a06876a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:23.328367 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-a9826af2-4e19-46e1-9e73-44719a06876a None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:23.330099 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-a9826af2-4e19-46e1-9e73-44719a06876a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:23.346016 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:23.412385 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2035078-af05-4338-a8cf-aa88dc8d560b None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:23.450892 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073949a0-4acf-4ed5-af7f-06de22f1082d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:23.451606 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073949a0-4acf-4ed5-af7f-06de22f1082d None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:23.451891 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073949a0-4acf-4ed5-af7f-06de22f1082d None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:23.452166 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073949a0-4acf-4ed5-af7f-06de22f1082d None admin] PATH_INFO: `/v3/projects/66779a17edc9443c8c1afeca9d6f3b11` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:23.453353 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073949a0-4acf-4ed5-af7f-06de22f1082d None admin] RBAC: Authorizing `identity:get_project(project_id=66779a17edc9443c8c1afeca9d6f3b11)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:23.455424 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073949a0-4acf-4ed5-af7f-06de22f1082d None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:23.457139 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 175/350] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jul 27 12:27:23 2022] GET /identity/v3/projects/66779a17edc9443c8c1afeca9d6f3b11 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:23.464042 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073949a0-4acf-4ed5-af7f-06de22f1082d None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:23.469232 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 176/351] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:27:23.470220 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9826af2-4e19-46e1-9e73-44719a06876a None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:23.576483 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073949a0-4acf-4ed5-af7f-06de22f1082d None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:23.589899 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:23.597987 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:23.611361 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9826af2-4e19-46e1-9e73-44719a06876a None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:23.621111 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014ba33-be43-4cb4-932b-f1c2ac74f3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:23.621796 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014ba33-be43-4cb4-932b-f1c2ac74f3ae None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:23.622086 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014ba33-be43-4cb4-932b-f1c2ac74f3ae None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:23.622369 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014ba33-be43-4cb4-932b-f1c2ac74f3ae None admin] PATH_INFO: `/v3/roles` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:23.623093 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014ba33-be43-4cb4-932b-f1c2ac74f3ae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:23.623401 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014ba33-be43-4cb4-932b-f1c2ac74f3ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:23.624808 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014ba33-be43-4cb4-932b-f1c2ac74f3ae None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:23.637419 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 176/352] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jul 27 12:27:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:23.638376 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014ba33-be43-4cb4-932b-f1c2ac74f3ae None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:23.670747 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b65ccd-53e2-466a-b60a-81b8e645b548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:23.671411 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b65ccd-53e2-466a-b60a-81b8e645b548 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:23.671858 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b65ccd-53e2-466a-b60a-81b8e645b548 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:23.672144 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b65ccd-53e2-466a-b60a-81b8e645b548 None admin] PATH_INFO: `/v3/groups/70a82f5c58b641bb8e06a2583077b27c` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:23.680481 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b65ccd-53e2-466a-b60a-81b8e645b548 None admin] RBAC: Authorizing `identity:get_group(group_id=70a82f5c58b641bb8e06a2583077b27c)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:23.682181 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b65ccd-53e2-466a-b60a-81b8e645b548 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:23.683962 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 177/353] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jul 27 12:27:23 2022] GET /identity/v3/groups/70a82f5c58b641bb8e06a2583077b27c => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:23.684750 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b65ccd-53e2-466a-b60a-81b8e645b548 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:23.762651 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014ba33-be43-4cb4-932b-f1c2ac74f3ae None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:23.800408 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236f2c4-1c9c-4989-95aa-96d9c1b2ca10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:23.801531 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236f2c4-1c9c-4989-95aa-96d9c1b2ca10 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:23.802076 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236f2c4-1c9c-4989-95aa-96d9c1b2ca10 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:23.802549 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236f2c4-1c9c-4989-95aa-96d9c1b2ca10 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:23.813326 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b65ccd-53e2-466a-b60a-81b8e645b548 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:23.814730 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236f2c4-1c9c-4989-95aa-96d9c1b2ca10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:23.820484 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-f236f2c4-1c9c-4989-95aa-96d9c1b2ca10 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 12:27:23.820484 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:23.820484 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:23.820484 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:23.820484 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:23.820484 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:23.820484 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:23.820484 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:23.820484 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:23.820484 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:23.820484 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:23.820484 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:23.820484 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:23.820484 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:23.820484 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:23.820484 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:23.821345 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:23.821345 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:23.821345 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:23.821345 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:23.821345 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:23.821345 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:23.821345 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:23.821345 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:23.821345 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:23.821345 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:23.821345 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:23.821345 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:23.821345 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:23.821345 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:23.821345 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:23.821345 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:23.822175 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:23.822175 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:23.822175 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:23.822175 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:23.822175 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:23.822175 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:23.822175 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:23.822175 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:23.822175 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:23.822175 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:23.822175 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 12:27:23.822175 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:23.824498 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 177/354] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:27:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:23.825732 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236f2c4-1c9c-4989-95aa-96d9c1b2ca10 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:23.849954 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2167cd-5609-41b1-8057-a7d97602d88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:23.850505 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2167cd-5609-41b1-8057-a7d97602d88f None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:23.850789 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2167cd-5609-41b1-8057-a7d97602d88f None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:23.851062 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2167cd-5609-41b1-8057-a7d97602d88f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:23.863882 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:23.872385 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:23.926663 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2167cd-5609-41b1-8057-a7d97602d88f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:23.928138 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2167cd-5609-41b1-8057-a7d97602d88f None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:23.935695 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236f2c4-1c9c-4989-95aa-96d9c1b2ca10 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:23.971652 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf7f1ba-be28-49c1-8547-40050b442b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:23.972656 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7f1ba-be28-49c1-8547-40050b442b97 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:23.973155 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7f1ba-be28-49c1-8547-40050b442b97 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:23.973653 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7f1ba-be28-49c1-8547-40050b442b97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:23.974675 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf7f1ba-be28-49c1-8547-40050b442b97 None admin] RBAC: Adding query filter params (group.id=70a82f5c58b641bb8e06a2583077b27c, role.id=2136377433854360927c578b39f16e6f, scope.project.id=66779a17edc9443c8c1afeca9d6f3b11) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:23.975186 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf7f1ba-be28-49c1-8547-40050b442b97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:23.976814 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf7f1ba-be28-49c1-8547-40050b442b97 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:23.989757 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 178/355] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Jul 27 12:27:23 2022] GET /identity/v3/role_assignments?group.id=70a82f5c58b641bb8e06a2583077b27c&scope.project.id=66779a17edc9443c8c1afeca9d6f3b11&role.id=2136377433854360927c578b39f16e6f => generated 260 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:23.991329 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf7f1ba-be28-49c1-8547-40050b442b97 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:24.041619 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 178/356] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jul 27 12:27:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 12:27:24.047467 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2167cd-5609-41b1-8057-a7d97602d88f None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:24.105165 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:24.165095 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2167cd-5609-41b1-8057-a7d97602d88f None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:24.197118 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:24.206200 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e83f7-a422-4588-b1de-4a2e398335d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:24.206431 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf7f1ba-be28-49c1-8547-40050b442b97 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:24.206857 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e83f7-a422-4588-b1de-4a2e398335d5 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:24.207143 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e83f7-a422-4588-b1de-4a2e398335d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:24.207422 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e83f7-a422-4588-b1de-4a2e398335d5 None admin] PATH_INFO: `/v3/projects/66779a17edc9443c8c1afeca9d6f3b11` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:24.208687 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306e83f7-a422-4588-b1de-4a2e398335d5 None admin] RBAC: Authorizing `identity:get_project(project_id=66779a17edc9443c8c1afeca9d6f3b11)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:24.210185 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306e83f7-a422-4588-b1de-4a2e398335d5 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:24.212264 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 179/357] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jul 27 12:27:24 2022] GET /identity/v3/projects/66779a17edc9443c8c1afeca9d6f3b11 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:24.219006 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e83f7-a422-4588-b1de-4a2e398335d5 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:24.257691 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5575db-449e-42b9-b71c-21dbdb6a9dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:24.258476 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5575db-449e-42b9-b71c-21dbdb6a9dc7 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:24.258766 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5575db-449e-42b9-b71c-21dbdb6a9dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:24.259046 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5575db-449e-42b9-b71c-21dbdb6a9dc7 None admin] PATH_INFO: `/v3/roles` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:24.259770 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5575db-449e-42b9-b71c-21dbdb6a9dc7 None admin] RBAC: Adding query filter params (name=member) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:24.260127 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5575db-449e-42b9-b71c-21dbdb6a9dc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:24.261564 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5575db-449e-42b9-b71c-21dbdb6a9dc7 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:24.270851 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 179/358] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jul 27 12:27:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:24.275984 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5575db-449e-42b9-b71c-21dbdb6a9dc7 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:24.408822 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5575db-449e-42b9-b71c-21dbdb6a9dc7 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:24.415602 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e83f7-a422-4588-b1de-4a2e398335d5 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:24.451239 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:24.452198 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a79aca-9517-4d5b-acaa-a95d3924bd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:24.453072 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a79aca-9517-4d5b-acaa-a95d3924bd2d None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:24.453582 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a79aca-9517-4d5b-acaa-a95d3924bd2d None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:24.454124 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a79aca-9517-4d5b-acaa-a95d3924bd2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:24.494402 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c834c-ebfc-487f-a432-7033bc0f0fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:24.494402 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c834c-ebfc-487f-a432-7033bc0f0fed None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:24.494402 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c834c-ebfc-487f-a432-7033bc0f0fed None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:24.494402 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c834c-ebfc-487f-a432-7033bc0f0fed None admin] PATH_INFO: `/v3/groups/70a82f5c58b641bb8e06a2583077b27c` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:24.495684 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c834c-ebfc-487f-a432-7033bc0f0fed None admin] RBAC: Authorizing `identity:get_group(group_id=70a82f5c58b641bb8e06a2583077b27c)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:24.497209 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c834c-ebfc-487f-a432-7033bc0f0fed None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:24.501379 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 180/359] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jul 27 12:27:24 2022] GET /identity/v3/groups/70a82f5c58b641bb8e06a2583077b27c => generated 226 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:24.506786 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c834c-ebfc-487f-a432-7033bc0f0fed None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:24.510729 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:24.580212 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a79aca-9517-4d5b-acaa-a95d3924bd2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:24.581709 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a79aca-9517-4d5b-acaa-a95d3924bd2d None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:24.665250 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c834c-ebfc-487f-a432-7033bc0f0fed None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:24.710399 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a24b06-4a1f-4928-a98f-c3949fb393f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:24.710624 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a24b06-4a1f-4928-a98f-c3949fb393f6 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:24.710837 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a24b06-4a1f-4928-a98f-c3949fb393f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:24.711106 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a24b06-4a1f-4928-a98f-c3949fb393f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:24.711904 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a24b06-4a1f-4928-a98f-c3949fb393f6 None admin] RBAC: Adding query filter params (group.id=70a82f5c58b641bb8e06a2583077b27c, role.id=28c0b3a6358343c398e7df818529a952, scope.project.id=66779a17edc9443c8c1afeca9d6f3b11) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:24.712804 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a24b06-4a1f-4928-a98f-c3949fb393f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:24.713677 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a24b06-4a1f-4928-a98f-c3949fb393f6 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:24.727916 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 181/360] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Jul 27 12:27:24 2022] GET /identity/v3/role_assignments?group.id=70a82f5c58b641bb8e06a2583077b27c&scope.project.id=66779a17edc9443c8c1afeca9d6f3b11&role.id=28c0b3a6358343c398e7df818529a952 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:24.727916 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285639c-2056-4a97-8937-0033b99006af None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:24.727916 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285639c-2056-4a97-8937-0033b99006af None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:24.727916 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285639c-2056-4a97-8937-0033b99006af None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:24.727916 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 182/361] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:24.727916 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97547f-3e79-4ff8-bb8c-a519b5fd7c1f None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:24.728477 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97547f-3e79-4ff8-bb8c-a519b5fd7c1f None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:24.728477 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97547f-3e79-4ff8-bb8c-a519b5fd7c1f None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:24.728477 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 183/362] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:24.734624 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0eccb-2535-477d-b47e-9b0bc53cf96b None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:24.734905 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0eccb-2535-477d-b47e-9b0bc53cf96b None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:24.735197 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0eccb-2535-477d-b47e-9b0bc53cf96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:24.742633 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 180/363] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jul 27 12:27:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 12:27:24.744083 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0024c-4f4d-420f-ad64-f5008394e042 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:24.744443 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0024c-4f4d-420f-ad64-f5008394e042 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:24.744800 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0024c-4f4d-420f-ad64-f5008394e042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:24.756835 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-3ac0eccb-2535-477d-b47e-9b0bc53cf96b None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:24.758309 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-3ac0eccb-2535-477d-b47e-9b0bc53cf96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:24.770306 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-dfb0024c-4f4d-420f-ad64-f5008394e042 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:24.771648 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-dfb0024c-4f4d-420f-ad64-f5008394e042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:24.824034 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:24.852032 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:24.852396 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 184/364] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:27:24.854033 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0eccb-2535-477d-b47e-9b0bc53cf96b None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:24.868498 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 181/365] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:27:24.903614 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0024c-4f4d-420f-ad64-f5008394e042 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:24.975613 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac0eccb-2535-477d-b47e-9b0bc53cf96b None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:25.023648 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26d982-e768-47fc-974c-177aa793043a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:25.024802 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26d982-e768-47fc-974c-177aa793043a None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:25.025226 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26d982-e768-47fc-974c-177aa793043a None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:25.025829 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26d982-e768-47fc-974c-177aa793043a None admin] PATH_INFO: `/v3/projects/252e28aa3a004a2c871b20abe82e81ee` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:25.028483 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc26d982-e768-47fc-974c-177aa793043a None admin] RBAC: Authorizing `identity:get_project(project_id=252e28aa3a004a2c871b20abe82e81ee)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:25.030126 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc26d982-e768-47fc-974c-177aa793043a None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:25.032752 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 185/366] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jul 27 12:27:24 2022] GET /identity/v3/projects/252e28aa3a004a2c871b20abe82e81ee => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:25.038005 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26d982-e768-47fc-974c-177aa793043a None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:25.049788 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0024c-4f4d-420f-ad64-f5008394e042 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:25.095940 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f123b9-413c-4e70-9a83-923c7701fc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:25.096886 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f123b9-413c-4e70-9a83-923c7701fc04 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:25.097308 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f123b9-413c-4e70-9a83-923c7701fc04 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:25.097788 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f123b9-413c-4e70-9a83-923c7701fc04 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:25.101021 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:25.111434 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f123b9-413c-4e70-9a83-923c7701fc04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:25.117025 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-56f123b9-413c-4e70-9a83-923c7701fc04 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 12:27:25.117025 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:25.117025 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:25.117025 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:25.117025 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:25.117025 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:25.117025 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:25.117025 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:25.117025 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:25.117025 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:25.117025 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:25.117025 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:25.117025 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:25.117025 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:25.117025 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:25.117025 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:25.118092 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:25.118092 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:25.118092 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:25.118092 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:25.118092 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:25.118092 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:25.118092 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:25.118092 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:25.118092 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:25.118092 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:25.118092 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:25.118092 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:25.118092 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:25.118092 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:25.118092 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:25.118092 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:25.118913 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:25.118913 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:25.118913 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:25.118913 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:25.118913 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:25.118913 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:25.118913 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:25.118913 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:25.118913 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:25.118913 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:25.118913 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 12:27:25.118913 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:25.121667 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 182/367] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jul 27 12:27:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:25.122669 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f123b9-413c-4e70-9a83-923c7701fc04 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:25.166708 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26d982-e768-47fc-974c-177aa793043a None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:25.180683 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:25.214689 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4419ed57-4379-47d5-865c-4700386505e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:25.215338 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419ed57-4379-47d5-865c-4700386505e3 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:25.215622 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419ed57-4379-47d5-865c-4700386505e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:25.215899 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419ed57-4379-47d5-865c-4700386505e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:25.229372 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4419ed57-4379-47d5-865c-4700386505e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:25.237111 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-4419ed57-4379-47d5-865c-4700386505e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 12:27:25.237111 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:25.237111 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:25.237111 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:25.237111 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:25.237111 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:25.237111 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:25.237111 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:25.237111 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:25.237111 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:25.237111 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:25.237111 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:25.237111 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:25.237111 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:25.237111 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:25.237111 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:25.238064 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:25.238064 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:25.238064 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:25.238064 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:25.238064 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:25.238064 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:25.238064 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:25.238064 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:25.238064 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:25.238064 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:25.238064 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:25.238064 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:25.238064 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:25.238064 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:25.238064 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:25.238064 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:25.238852 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:25.238852 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:25.238852 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:25.238852 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:25.238852 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:25.238852 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:25.238852 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:25.238852 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:25.238852 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:25.238852 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:25.238852 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 12:27:25.238852 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:25.238852 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 186/368] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jul 27 12:27:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:25.239525 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4419ed57-4379-47d5-865c-4700386505e3 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:25.249162 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f123b9-413c-4e70-9a83-923c7701fc04 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:25.294301 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eefa302-35a5-4794-b421-ac7ebf8c309c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:25.295343 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefa302-35a5-4794-b421-ac7ebf8c309c None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:25.295845 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefa302-35a5-4794-b421-ac7ebf8c309c None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:25.296646 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefa302-35a5-4794-b421-ac7ebf8c309c None admin] PATH_INFO: `/v3/groups/70a82f5c58b641bb8e06a2583077b27c` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:25.300067 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eefa302-35a5-4794-b421-ac7ebf8c309c None admin] RBAC: Authorizing `identity:get_group(group_id=70a82f5c58b641bb8e06a2583077b27c)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:25.302511 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eefa302-35a5-4794-b421-ac7ebf8c309c None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:25.304643 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 183/369] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jul 27 12:27:25 2022] GET /identity/v3/groups/70a82f5c58b641bb8e06a2583077b27c => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:25.306070 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eefa302-35a5-4794-b421-ac7ebf8c309c None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:25.380677 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4419ed57-4379-47d5-865c-4700386505e3 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:25.392653 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:25.428261 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483170a-648d-48ae-8f3a-29c4ed80c927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:25.428980 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483170a-648d-48ae-8f3a-29c4ed80c927 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:25.429271 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483170a-648d-48ae-8f3a-29c4ed80c927 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:25.429552 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483170a-648d-48ae-8f3a-29c4ed80c927 None admin] PATH_INFO: `/v3/roles` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:25.431629 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483170a-648d-48ae-8f3a-29c4ed80c927 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:25.431813 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483170a-648d-48ae-8f3a-29c4ed80c927 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:25.433673 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483170a-648d-48ae-8f3a-29c4ed80c927 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:25.447767 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 187/370] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jul 27 12:27:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:25.448939 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483170a-648d-48ae-8f3a-29c4ed80c927 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:25.455280 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eefa302-35a5-4794-b421-ac7ebf8c309c None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:25.495386 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:25.501684 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d285ac1-9de4-40ab-b620-c8122b89fadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:25.502325 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d285ac1-9de4-40ab-b620-c8122b89fadc None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:25.502605 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d285ac1-9de4-40ab-b620-c8122b89fadc None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:25.502877 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d285ac1-9de4-40ab-b620-c8122b89fadc None admin] PATH_INFO: `/v3/roles` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:25.503598 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d285ac1-9de4-40ab-b620-c8122b89fadc None admin] RBAC: Adding query filter params (name=admin) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:25.503898 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d285ac1-9de4-40ab-b620-c8122b89fadc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:25.505278 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d285ac1-9de4-40ab-b620-c8122b89fadc None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:25.521180 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 184/371] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:27:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:25.525278 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d285ac1-9de4-40ab-b620-c8122b89fadc None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:25.609339 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483170a-648d-48ae-8f3a-29c4ed80c927 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:25.655236 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee42a5-6821-4cb0-8ae5-eeecbca03a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:25.655605 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee42a5-6821-4cb0-8ae5-eeecbca03a13 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:25.655885 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee42a5-6821-4cb0-8ae5-eeecbca03a13 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:25.656162 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee42a5-6821-4cb0-8ae5-eeecbca03a13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:25.656944 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ee42a5-6821-4cb0-8ae5-eeecbca03a13 None admin] RBAC: Adding query filter params (group.id=70a82f5c58b641bb8e06a2583077b27c, role.id=2136377433854360927c578b39f16e6f, scope.project.id=252e28aa3a004a2c871b20abe82e81ee) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:25.657354 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ee42a5-6821-4cb0-8ae5-eeecbca03a13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:25.658857 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ee42a5-6821-4cb0-8ae5-eeecbca03a13 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:25.662686 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d285ac1-9de4-40ab-b620-c8122b89fadc None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:25.664881 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 188/372] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Jul 27 12:27:25 2022] GET /identity/v3/role_assignments?group.id=70a82f5c58b641bb8e06a2583077b27c&scope.project.id=252e28aa3a004a2c871b20abe82e81ee&role.id=2136377433854360927c578b39f16e6f => generated 260 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:25.674044 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee42a5-6821-4cb0-8ae5-eeecbca03a13 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:25.703412 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8622e4-0bbb-49c9-bd5d-ec9b09d5eba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:25.704971 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8622e4-0bbb-49c9-bd5d-ec9b09d5eba8 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:25.705490 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8622e4-0bbb-49c9-bd5d-ec9b09d5eba8 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:25.706005 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8622e4-0bbb-49c9-bd5d-ec9b09d5eba8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:25.729852 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:25.786095 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:25.794614 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8622e4-0bbb-49c9-bd5d-ec9b09d5eba8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:25.796748 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8622e4-0bbb-49c9-bd5d-ec9b09d5eba8 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:25.857975 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee42a5-6821-4cb0-8ae5-eeecbca03a13 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:25.899295 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178585e-f419-4937-aa94-31442d5f42c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:25.900118 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178585e-f419-4937-aa94-31442d5f42c4 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:25.900409 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178585e-f419-4937-aa94-31442d5f42c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:25.900680 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178585e-f419-4937-aa94-31442d5f42c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:25.977042 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 185/373] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jul 27 12:27:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 12:27:25.982807 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8622e4-0bbb-49c9-bd5d-ec9b09d5eba8 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:25.993786 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178585e-f419-4937-aa94-31442d5f42c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:25.995972 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178585e-f419-4937-aa94-31442d5f42c4 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:26.039549 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:26.072591 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:26.097633 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8622e4-0bbb-49c9-bd5d-ec9b09d5eba8 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:26.136180 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c73ef6c-d649-4cdf-821f-d4ecd6222ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:26.136837 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73ef6c-d649-4cdf-821f-d4ecd6222ab6 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:26.137118 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73ef6c-d649-4cdf-821f-d4ecd6222ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:26.137396 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73ef6c-d649-4cdf-821f-d4ecd6222ab6 None admin] PATH_INFO: `/v3/projects/252e28aa3a004a2c871b20abe82e81ee` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:26.139278 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c73ef6c-d649-4cdf-821f-d4ecd6222ab6 None admin] RBAC: Authorizing `identity:get_project(project_id=252e28aa3a004a2c871b20abe82e81ee)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:26.140722 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c73ef6c-d649-4cdf-821f-d4ecd6222ab6 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:26.143642 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 186/374] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jul 27 12:27:25 2022] GET /identity/v3/projects/252e28aa3a004a2c871b20abe82e81ee => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:26.151128 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c73ef6c-d649-4cdf-821f-d4ecd6222ab6 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:26.157099 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 189/375] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jul 27 12:27:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 12:27:26.162570 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178585e-f419-4937-aa94-31442d5f42c4 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:26.313851 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178585e-f419-4937-aa94-31442d5f42c4 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:26.327707 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c73ef6c-d649-4cdf-821f-d4ecd6222ab6 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:26.370646 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f380747-9e21-460a-9175-0d096b91ba0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:26.371305 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f380747-9e21-460a-9175-0d096b91ba0b None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:26.371585 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f380747-9e21-460a-9175-0d096b91ba0b None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:26.371862 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f380747-9e21-460a-9175-0d096b91ba0b None admin] PATH_INFO: `/v3/projects/618eab11857d49309c9a7cb9985a7981` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:26.373028 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f380747-9e21-460a-9175-0d096b91ba0b None admin] RBAC: Authorizing `identity:get_project(project_id=618eab11857d49309c9a7cb9985a7981)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:26.374766 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f380747-9e21-460a-9175-0d096b91ba0b None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:26.377273 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 190/376] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jul 27 12:27:26 2022] GET /identity/v3/projects/618eab11857d49309c9a7cb9985a7981 => generated 344 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:27:26.382951 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f380747-9e21-460a-9175-0d096b91ba0b None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:26.393858 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:26.402616 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5e681-4616-4265-bde1-3cd7f292139d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:26.403279 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5e681-4616-4265-bde1-3cd7f292139d None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:26.403565 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5e681-4616-4265-bde1-3cd7f292139d None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:26.403844 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5e681-4616-4265-bde1-3cd7f292139d None admin] PATH_INFO: `/v3/groups/70a82f5c58b641bb8e06a2583077b27c` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:26.405031 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd5e681-4616-4265-bde1-3cd7f292139d None admin] RBAC: Authorizing `identity:get_group(group_id=70a82f5c58b641bb8e06a2583077b27c)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:26.406558 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd5e681-4616-4265-bde1-3cd7f292139d None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:26.412153 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 187/377] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jul 27 12:27:26 2022] GET /identity/v3/groups/70a82f5c58b641bb8e06a2583077b27c => generated 226 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:26.416456 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5e681-4616-4265-bde1-3cd7f292139d None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:26.446000 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:26.549234 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f380747-9e21-460a-9175-0d096b91ba0b None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:26.593706 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a8303-fcbd-434a-a6c8-8933f95b15c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:26.594296 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a8303-fcbd-434a-a6c8-8933f95b15c8 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:26.594778 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a8303-fcbd-434a-a6c8-8933f95b15c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:26.595689 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a8303-fcbd-434a-a6c8-8933f95b15c8 None admin] PATH_INFO: `/v3/groups/824dc54828d14a54a21d6e567531f5c4` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:26.608096 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a8303-fcbd-434a-a6c8-8933f95b15c8 None admin] RBAC: Authorizing `identity:get_group(group_id=824dc54828d14a54a21d6e567531f5c4)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:26.609899 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a8303-fcbd-434a-a6c8-8933f95b15c8 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:26.613374 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 191/378] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jul 27 12:27:26 2022] GET /identity/v3/groups/824dc54828d14a54a21d6e567531f5c4 => generated 229 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:26.631538 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a8303-fcbd-434a-a6c8-8933f95b15c8 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:26.675793 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5e681-4616-4265-bde1-3cd7f292139d None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:26.714012 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:26.752340 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a8303-fcbd-434a-a6c8-8933f95b15c8 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:26.774456 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af9931-12fd-46b0-a56f-58233fc00049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:26.775114 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af9931-12fd-46b0-a56f-58233fc00049 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:26.775398 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af9931-12fd-46b0-a56f-58233fc00049 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:26.775673 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af9931-12fd-46b0-a56f-58233fc00049 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:26.776493 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af9931-12fd-46b0-a56f-58233fc00049 None admin] RBAC: Adding query filter params (group.id=70a82f5c58b641bb8e06a2583077b27c, role.id=28c0b3a6358343c398e7df818529a952, scope.project.id=252e28aa3a004a2c871b20abe82e81ee) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:26.776804 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af9931-12fd-46b0-a56f-58233fc00049 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:26.778348 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af9931-12fd-46b0-a56f-58233fc00049 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:26.792038 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1dd362-47c6-40f7-8253-b44c15ea32c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:26.792689 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1dd362-47c6-40f7-8253-b44c15ea32c9 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:26.792974 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1dd362-47c6-40f7-8253-b44c15ea32c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:26.793256 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1dd362-47c6-40f7-8253-b44c15ea32c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:26.794126 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1dd362-47c6-40f7-8253-b44c15ea32c9 None admin] RBAC: Adding query filter params (group.id=824dc54828d14a54a21d6e567531f5c4, role.id=af00ed97066e4c72aeb6cd3d5b5d15c9, scope.project.id=618eab11857d49309c9a7cb9985a7981) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:26.794443 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1dd362-47c6-40f7-8253-b44c15ea32c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:26.796128 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1dd362-47c6-40f7-8253-b44c15ea32c9 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:26.796269 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 188/379] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Jul 27 12:27:26 2022] GET /identity/v3/role_assignments?group.id=70a82f5c58b641bb8e06a2583077b27c&scope.project.id=252e28aa3a004a2c871b20abe82e81ee&role.id=28c0b3a6358343c398e7df818529a952 => generated 260 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:26.803279 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 192/380] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Jul 27 12:27:26 2022] GET /identity/v3/role_assignments?group.id=824dc54828d14a54a21d6e567531f5c4&scope.project.id=618eab11857d49309c9a7cb9985a7981&role.id=af00ed97066e4c72aeb6cd3d5b5d15c9 => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:27:26.958867 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97bb60-8e69-4f74-b0cc-bb676b189409 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:26.959064 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97bb60-8e69-4f74-b0cc-bb676b189409 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:26.959539 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97bb60-8e69-4f74-b0cc-bb676b189409 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:26.961169 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 189/381] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:26.967418 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7d8bc-bdc2-4b60-8a87-476cc6b39f9a None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:26.967851 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7d8bc-bdc2-4b60-8a87-476cc6b39f9a None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:26.968044 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7d8bc-bdc2-4b60-8a87-476cc6b39f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:26.989385 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-97c7d8bc-bdc2-4b60-8a87-476cc6b39f9a None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:26.990888 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-97c7d8bc-bdc2-4b60-8a87-476cc6b39f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:27.079419 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 193/382] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:27:27.103974 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97bb60-8e69-4f74-b0cc-bb676b189409 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:27.197026 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:27.216866 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97bb60-8e69-4f74-b0cc-bb676b189409 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:27.253628 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d51e8-f689-4c40-9f04-d2a9887caef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:27.253968 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d51e8-f689-4c40-9f04-d2a9887caef4 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:27.254247 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d51e8-f689-4c40-9f04-d2a9887caef4 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:27.254527 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d51e8-f689-4c40-9f04-d2a9887caef4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:27.269625 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d51e8-f689-4c40-9f04-d2a9887caef4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:27.271211 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-972d51e8-f689-4c40-9f04-d2a9887caef4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 12:27:27.271211 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:27.271211 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:27.271211 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:27.271211 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:27.271211 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:27.271211 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:27.271211 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:27.271211 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:27.271211 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:27.271211 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:27.271211 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:27.271211 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:27.271211 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:27.271211 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:27.271211 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:27.272086 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:27.272086 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:27.272086 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:27.272086 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:27.272086 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:27.272086 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:27.272086 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:27.272086 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:27.272086 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:27.272086 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:27.272086 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:27.272086 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:27.272086 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:27.272086 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:27.272086 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:27.272086 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:27.272899 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:27.272899 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:27.272899 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:27.272899 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:27.272899 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:27.272899 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:27.272899 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:27.272899 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:27.272899 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:27.272899 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:27.272899 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 12:27:27.272899 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:27.272899 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 190/383] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:27:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:27.287075 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7d8bc-bdc2-4b60-8a87-476cc6b39f9a None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:27.437344 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:27.535859 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7d8bc-bdc2-4b60-8a87-476cc6b39f9a None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:27.602344 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76baa07-1261-49f7-9b05-c031a794714a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:27.602996 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76baa07-1261-49f7-9b05-c031a794714a None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:27.603284 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76baa07-1261-49f7-9b05-c031a794714a None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:27.603562 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76baa07-1261-49f7-9b05-c031a794714a None admin] PATH_INFO: `/v3/roles` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:27.604300 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76baa07-1261-49f7-9b05-c031a794714a None admin] RBAC: Adding query filter params (name=member) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:27.604611 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76baa07-1261-49f7-9b05-c031a794714a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:27.606033 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76baa07-1261-49f7-9b05-c031a794714a None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:27.621575 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 194/384] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jul 27 12:27:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:27.630694 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d51e8-f689-4c40-9f04-d2a9887caef4 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:27.721368 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc3af1-da10-42bd-8986-35710d7629bf None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:27.722117 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc3af1-da10-42bd-8986-35710d7629bf None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:27.722496 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc3af1-da10-42bd-8986-35710d7629bf None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:27.725224 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 195/385] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:27.730715 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ca78d-5ec3-4965-8e3c-afcce23489a6 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:27.731112 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ca78d-5ec3-4965-8e3c-afcce23489a6 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:27.731484 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ca78d-5ec3-4965-8e3c-afcce23489a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:27.778622 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-b44ca78d-5ec3-4965-8e3c-afcce23489a6 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:27.780002 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-b44ca78d-5ec3-4965-8e3c-afcce23489a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:27.843935 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d51e8-f689-4c40-9f04-d2a9887caef4 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:27.895637 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22465af5-a809-450b-a67d-9a8330689345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:27.896652 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22465af5-a809-450b-a67d-9a8330689345 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:27.897177 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22465af5-a809-450b-a67d-9a8330689345 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:27.897712 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22465af5-a809-450b-a67d-9a8330689345 None admin] PATH_INFO: `/v3/groups/70a82f5c58b641bb8e06a2583077b27c` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:27.899124 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22465af5-a809-450b-a67d-9a8330689345 None admin] RBAC: Authorizing `identity:get_group(group_id=70a82f5c58b641bb8e06a2583077b27c)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:27.900745 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22465af5-a809-450b-a67d-9a8330689345 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:27.902892 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 191/386] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jul 27 12:27:27 2022] GET /identity/v3/groups/70a82f5c58b641bb8e06a2583077b27c => generated 226 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:27.909051 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22465af5-a809-450b-a67d-9a8330689345 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:27.929303 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:27.964590 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 196/387] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:27:28.001958 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ca78d-5ec3-4965-8e3c-afcce23489a6 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:28.029962 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22465af5-a809-450b-a67d-9a8330689345 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:28.067199 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7b0c8-9f22-4454-a358-02ac84151a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:28.068099 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7b0c8-9f22-4454-a358-02ac84151a98 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:28.068528 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7b0c8-9f22-4454-a358-02ac84151a98 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:28.068948 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7b0c8-9f22-4454-a358-02ac84151a98 None admin] PATH_INFO: `/v3/projects/66779a17edc9443c8c1afeca9d6f3b11` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:28.070426 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d7b0c8-9f22-4454-a358-02ac84151a98 None admin] RBAC: Authorizing `identity:get_project(project_id=66779a17edc9443c8c1afeca9d6f3b11)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:28.072039 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d7b0c8-9f22-4454-a358-02ac84151a98 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:28.074709 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 192/388] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jul 27 12:27:27 2022] GET /identity/v3/projects/66779a17edc9443c8c1afeca9d6f3b11 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:28.081067 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7b0c8-9f22-4454-a358-02ac84151a98 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:28.106492 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:28.176549 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ca78d-5ec3-4965-8e3c-afcce23489a6 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:28.201934 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:28.236805 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bccfa2-6b7c-42cd-89d1-5faaf6073ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:28.237468 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bccfa2-6b7c-42cd-89d1-5faaf6073ba1 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:28.237818 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bccfa2-6b7c-42cd-89d1-5faaf6073ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:28.238107 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bccfa2-6b7c-42cd-89d1-5faaf6073ba1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:28.246757 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d7b0c8-9f22-4454-a358-02ac84151a98 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:28.249512 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bccfa2-6b7c-42cd-89d1-5faaf6073ba1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:28.255810 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-26bccfa2-6b7c-42cd-89d1-5faaf6073ba1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 12:27:28.255810 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:28.255810 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:28.255810 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:28.255810 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:28.255810 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:28.255810 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:28.255810 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:28.255810 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:28.255810 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:28.255810 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:28.255810 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:28.255810 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:28.255810 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:28.255810 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:28.255810 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:28.256785 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:28.256785 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:28.256785 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:28.256785 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:28.256785 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:28.256785 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:28.256785 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:28.256785 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:28.256785 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:28.256785 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:28.256785 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:28.256785 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:28.256785 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:28.256785 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:28.256785 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:28.256785 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:28.257795 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:28.257795 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:28.257795 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:28.257795 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:28.257795 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:28.257795 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:28.257795 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:28.257795 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:28.257795 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:28.257795 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:28.257795 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 12:27:28.257795 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:28.257795 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 197/389] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jul 27 12:27:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:28.263408 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bccfa2-6b7c-42cd-89d1-5faaf6073ba1 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:28.337579 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47634ade-1f65-41a2-828d-9bdabd1b3138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:28.338297 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47634ade-1f65-41a2-828d-9bdabd1b3138 None admin] REQUEST_METHOD: `PUT` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:28.338578 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47634ade-1f65-41a2-828d-9bdabd1b3138 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:28.338854 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47634ade-1f65-41a2-828d-9bdabd1b3138 None admin] PATH_INFO: `/v3/projects/66779a17edc9443c8c1afeca9d6f3b11/groups/70a82f5c58b641bb8e06a2583077b27c/roles/2136377433854360927c578b39f16e6f` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:28.340782 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47634ade-1f65-41a2-828d-9bdabd1b3138 None admin] RBAC: Authorizing `identity:create_grant(project_id=66779a17edc9443c8c1afeca9d6f3b11, group_id=70a82f5c58b641bb8e06a2583077b27c, role_id=2136377433854360927c578b39f16e6f)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:28.342267 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47634ade-1f65-41a2-828d-9bdabd1b3138 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:28.368752 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 193/390] 10.222.0.55 () {58 vars in 1442 bytes} [Wed Jul 27 12:27:28 2022] PUT /identity/v3/projects/66779a17edc9443c8c1afeca9d6f3b11/groups/70a82f5c58b641bb8e06a2583077b27c/roles/2136377433854360927c578b39f16e6f => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 12:27:28.378680 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bccfa2-6b7c-42cd-89d1-5faaf6073ba1 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:28.404425 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:28.418808 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add456c5-428f-49cd-87b3-2af09d2928e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:28.419447 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add456c5-428f-49cd-87b3-2af09d2928e6 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:28.419729 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add456c5-428f-49cd-87b3-2af09d2928e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:28.420005 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add456c5-428f-49cd-87b3-2af09d2928e6 None admin] PATH_INFO: `/v3/roles` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:28.420740 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add456c5-428f-49cd-87b3-2af09d2928e6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:28.421046 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add456c5-428f-49cd-87b3-2af09d2928e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:28.422649 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add456c5-428f-49cd-87b3-2af09d2928e6 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:28.433540 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 198/391] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jul 27 12:27:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:28.439517 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47634ade-1f65-41a2-828d-9bdabd1b3138 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:28.599166 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47634ade-1f65-41a2-828d-9bdabd1b3138 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:28.636170 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116dac13-6a24-4501-8eb2-a7eff4ab452e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:28.636738 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116dac13-6a24-4501-8eb2-a7eff4ab452e None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:28.637018 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116dac13-6a24-4501-8eb2-a7eff4ab452e None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:28.637310 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116dac13-6a24-4501-8eb2-a7eff4ab452e None admin] PATH_INFO: `/v3/groups/70a82f5c58b641bb8e06a2583077b27c` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:28.638563 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116dac13-6a24-4501-8eb2-a7eff4ab452e None admin] RBAC: Authorizing `identity:get_group(group_id=70a82f5c58b641bb8e06a2583077b27c)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:28.639989 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116dac13-6a24-4501-8eb2-a7eff4ab452e None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:28.644065 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 194/392] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jul 27 12:27:28 2022] GET /identity/v3/groups/70a82f5c58b641bb8e06a2583077b27c => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:28.647705 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add456c5-428f-49cd-87b3-2af09d2928e6 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:28.776275 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add456c5-428f-49cd-87b3-2af09d2928e6 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:28.824511 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc39ce-98d2-4b93-b5d9-384991f6f7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:28.825164 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc39ce-98d2-4b93-b5d9-384991f6f7dc None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:28.825445 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc39ce-98d2-4b93-b5d9-384991f6f7dc None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:28.825752 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc39ce-98d2-4b93-b5d9-384991f6f7dc None admin] PATH_INFO: `/v3/projects/66779a17edc9443c8c1afeca9d6f3b11` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:28.826908 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc39ce-98d2-4b93-b5d9-384991f6f7dc None admin] RBAC: Authorizing `identity:get_project(project_id=66779a17edc9443c8c1afeca9d6f3b11)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:28.828352 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc39ce-98d2-4b93-b5d9-384991f6f7dc None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:28.830288 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 199/393] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jul 27 12:27:28 2022] GET /identity/v3/projects/66779a17edc9443c8c1afeca9d6f3b11 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:28.835670 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116dac13-6a24-4501-8eb2-a7eff4ab452e None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:28.839565 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:28.962787 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116dac13-6a24-4501-8eb2-a7eff4ab452e None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:29.004862 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd017ed-6352-4eb1-96e3-d13a6cf03cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:29.005545 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd017ed-6352-4eb1-96e3-d13a6cf03cb2 None admin] REQUEST_METHOD: `PUT` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:29.005885 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd017ed-6352-4eb1-96e3-d13a6cf03cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:29.006163 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd017ed-6352-4eb1-96e3-d13a6cf03cb2 None admin] PATH_INFO: `/v3/projects/66779a17edc9443c8c1afeca9d6f3b11/groups/70a82f5c58b641bb8e06a2583077b27c/roles/28c0b3a6358343c398e7df818529a952` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:29.008392 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd017ed-6352-4eb1-96e3-d13a6cf03cb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=66779a17edc9443c8c1afeca9d6f3b11, group_id=70a82f5c58b641bb8e06a2583077b27c, role_id=28c0b3a6358343c398e7df818529a952)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:29.012214 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd017ed-6352-4eb1-96e3-d13a6cf03cb2 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:29.028928 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 195/394] 10.222.0.55 () {58 vars in 1442 bytes} [Wed Jul 27 12:27:28 2022] PUT /identity/v3/projects/66779a17edc9443c8c1afeca9d6f3b11/groups/70a82f5c58b641bb8e06a2583077b27c/roles/28c0b3a6358343c398e7df818529a952 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 12:27:29.098703 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f521d4-6bbf-4c9b-bf19-80f116fd33c1 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:29.099048 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f521d4-6bbf-4c9b-bf19-80f116fd33c1 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:29.099261 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f521d4-6bbf-4c9b-bf19-80f116fd33c1 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:29.100794 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 200/395] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:29.106685 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56436fa-cb82-46f0-a86a-31bf776b34d9 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:29.106976 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56436fa-cb82-46f0-a86a-31bf776b34d9 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:29.107245 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56436fa-cb82-46f0-a86a-31bf776b34d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:29.129104 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-b56436fa-cb82-46f0-a86a-31bf776b34d9 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:29.130448 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-b56436fa-cb82-46f0-a86a-31bf776b34d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:29.207943 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:29.217958 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 196/396] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:27:29.245815 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f521d4-6bbf-4c9b-bf19-80f116fd33c1 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:29.294212 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:29.360952 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f521d4-6bbf-4c9b-bf19-80f116fd33c1 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:29.397114 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d795a4-b619-493f-b1b8-d2f5384a7d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:29.397786 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d795a4-b619-493f-b1b8-d2f5384a7d29 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:29.398068 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d795a4-b619-493f-b1b8-d2f5384a7d29 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:29.398341 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d795a4-b619-493f-b1b8-d2f5384a7d29 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:29.409164 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d795a4-b619-493f-b1b8-d2f5384a7d29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:29.414228 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-21d795a4-b619-493f-b1b8-d2f5384a7d29 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 12:27:29.414228 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:29.414228 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:29.414228 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:29.414228 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:29.414228 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:29.414228 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:29.414228 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:29.414228 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:29.414228 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:29.414228 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:29.414228 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:29.414228 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:29.414228 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:29.414228 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:29.414228 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:29.415117 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:29.415117 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:29.415117 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:29.415117 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:29.415117 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:29.415117 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:29.415117 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:29.415117 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:29.415117 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:29.415117 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:29.415117 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:29.415117 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:29.415117 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:29.415117 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:29.415117 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:29.415117 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:29.416307 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:29.416307 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:29.416307 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:29.416307 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:29.416307 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:29.416307 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:29.416307 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:29.416307 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:29.416307 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:29.416307 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:29.416307 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 12:27:29.416307 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:29.416307 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 201/397] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:27:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:29.421804 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56436fa-cb82-46f0-a86a-31bf776b34d9 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:29.550151 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56436fa-cb82-46f0-a86a-31bf776b34d9 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:29.589238 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009910f-9b8e-45ef-acd7-19178730b16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:29.593756 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009910f-9b8e-45ef-acd7-19178730b16b None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:29.594076 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009910f-9b8e-45ef-acd7-19178730b16b None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:29.594365 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009910f-9b8e-45ef-acd7-19178730b16b None admin] PATH_INFO: `/v3/roles` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:29.595645 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009910f-9b8e-45ef-acd7-19178730b16b None admin] RBAC: Adding query filter params (name=member) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:29.595955 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009910f-9b8e-45ef-acd7-19178730b16b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:29.597344 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009910f-9b8e-45ef-acd7-19178730b16b None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:29.606427 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 197/398] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jul 27 12:27:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:29.612391 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d795a4-b619-493f-b1b8-d2f5384a7d29 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:29.684036 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a54036-fa97-4678-8cd2-513e605489b2 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:29.684336 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a54036-fa97-4678-8cd2-513e605489b2 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:29.684602 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a54036-fa97-4678-8cd2-513e605489b2 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:29.686273 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 198/399] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 12:27:29.692967 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def86241-6124-4659-80d4-5ae48ac8f3c6 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:29.693469 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def86241-6124-4659-80d4-5ae48ac8f3c6 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:29.693962 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def86241-6124-4659-80d4-5ae48ac8f3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:29.724725 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-def86241-6124-4659-80d4-5ae48ac8f3c6 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:29.726729 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-def86241-6124-4659-80d4-5ae48ac8f3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:29.813896 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d795a4-b619-493f-b1b8-d2f5384a7d29 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:29.816502 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:29.817932 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:29.848888 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 199/400] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:27:29.866502 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e96080-3800-460d-aa48-ddb3a4e71f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:29.867208 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e96080-3800-460d-aa48-ddb3a4e71f63 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:29.867490 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e96080-3800-460d-aa48-ddb3a4e71f63 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:29.867764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e96080-3800-460d-aa48-ddb3a4e71f63 None admin] PATH_INFO: `/v3/groups/70a82f5c58b641bb8e06a2583077b27c` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:29.868974 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e96080-3800-460d-aa48-ddb3a4e71f63 None admin] RBAC: Authorizing `identity:get_group(group_id=70a82f5c58b641bb8e06a2583077b27c)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:29.870429 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e96080-3800-460d-aa48-ddb3a4e71f63 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:29.872358 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 202/401] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jul 27 12:27:29 2022] GET /identity/v3/groups/70a82f5c58b641bb8e06a2583077b27c => generated 226 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:29.875027 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def86241-6124-4659-80d4-5ae48ac8f3c6 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:29.877636 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e96080-3800-460d-aa48-ddb3a4e71f63 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:30.047131 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def86241-6124-4659-80d4-5ae48ac8f3c6 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:30.076557 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e96080-3800-460d-aa48-ddb3a4e71f63 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:30.089139 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144153ad-d666-41d9-ae69-657dc93227ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:30.089828 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144153ad-d666-41d9-ae69-657dc93227ed None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:30.090664 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144153ad-d666-41d9-ae69-657dc93227ed None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:30.090943 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144153ad-d666-41d9-ae69-657dc93227ed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:30.103833 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144153ad-d666-41d9-ae69-657dc93227ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:30.109135 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-144153ad-d666-41d9-ae69-657dc93227ed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 12:27:30.109135 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:30.109135 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:30.109135 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:30.109135 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:30.109135 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:30.109135 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:30.109135 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:30.109135 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:30.109135 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:30.109135 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:30.109135 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:30.109135 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:30.109135 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:30.109135 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:30.109135 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:30.110246 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:30.110246 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:30.110246 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:30.110246 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:30.110246 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:30.110246 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:30.110246 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:30.110246 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:30.110246 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:30.110246 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:30.110246 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:30.110246 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:30.110246 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:30.110246 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:30.110246 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:30.110246 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:30.111280 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:30.111280 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:30.111280 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:30.111280 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:30.111280 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:30.111280 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:30.111280 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:30.111280 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:30.111280 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:30.111280 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:30.111280 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 12:27:30.111280 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:30.111280 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 200/402] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jul 27 12:27:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:30.120780 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144153ad-d666-41d9-ae69-657dc93227ed None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:30.170669 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addebff2-6ce3-405c-87ad-4e7154caab32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:30.171342 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addebff2-6ce3-405c-87ad-4e7154caab32 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:30.171624 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addebff2-6ce3-405c-87ad-4e7154caab32 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:30.171906 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addebff2-6ce3-405c-87ad-4e7154caab32 None admin] PATH_INFO: `/v3/projects/252e28aa3a004a2c871b20abe82e81ee` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:30.178242 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addebff2-6ce3-405c-87ad-4e7154caab32 None admin] RBAC: Authorizing `identity:get_project(project_id=252e28aa3a004a2c871b20abe82e81ee)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:30.179728 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addebff2-6ce3-405c-87ad-4e7154caab32 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:30.181763 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 203/403] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jul 27 12:27:29 2022] GET /identity/v3/projects/252e28aa3a004a2c871b20abe82e81ee => generated 302 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:30.187187 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addebff2-6ce3-405c-87ad-4e7154caab32 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:30.200925 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:30.272787 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:30.284028 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144153ad-d666-41d9-ae69-657dc93227ed None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:30.356651 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaea655-9054-4fb3-86fa-72eabd1a49c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:30.358289 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaea655-9054-4fb3-86fa-72eabd1a49c6 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:30.358842 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaea655-9054-4fb3-86fa-72eabd1a49c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:30.359122 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaea655-9054-4fb3-86fa-72eabd1a49c6 None admin] PATH_INFO: `/v3/roles` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:30.360102 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaea655-9054-4fb3-86fa-72eabd1a49c6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:30.360440 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaea655-9054-4fb3-86fa-72eabd1a49c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:30.362572 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaea655-9054-4fb3-86fa-72eabd1a49c6 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:30.370055 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addebff2-6ce3-405c-87ad-4e7154caab32 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:30.374657 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 201/404] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jul 27 12:27:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:30.376437 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b9d20-e5ce-478a-87a7-25b39d3fdbe1 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:30.376783 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b9d20-e5ce-478a-87a7-25b39d3fdbe1 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:30.377071 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b9d20-e5ce-478a-87a7-25b39d3fdbe1 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:30.379068 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 202/405] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:30.382877 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b9d20-e5ce-478a-87a7-25b39d3fdbe1 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:30.420259 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093830a2-ac14-433f-8808-258c21b99b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:30.420939 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093830a2-ac14-433f-8808-258c21b99b22 None admin] REQUEST_METHOD: `PUT` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:30.421223 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093830a2-ac14-433f-8808-258c21b99b22 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:30.421498 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093830a2-ac14-433f-8808-258c21b99b22 None admin] PATH_INFO: `/v3/projects/252e28aa3a004a2c871b20abe82e81ee/groups/70a82f5c58b641bb8e06a2583077b27c/roles/2136377433854360927c578b39f16e6f` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:30.432229 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093830a2-ac14-433f-8808-258c21b99b22 None admin] RBAC: Authorizing `identity:create_grant(project_id=252e28aa3a004a2c871b20abe82e81ee, group_id=70a82f5c58b641bb8e06a2583077b27c, role_id=2136377433854360927c578b39f16e6f)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:30.433726 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093830a2-ac14-433f-8808-258c21b99b22 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:30.448846 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 204/406] 10.222.0.55 () {58 vars in 1442 bytes} [Wed Jul 27 12:27:30 2022] PUT /identity/v3/projects/252e28aa3a004a2c871b20abe82e81ee/groups/70a82f5c58b641bb8e06a2583077b27c/roles/2136377433854360927c578b39f16e6f => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 12:27:30.455220 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f60f8-8bde-4bc0-8b1f-d61f6fc46bfc None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:30.455545 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f60f8-8bde-4bc0-8b1f-d61f6fc46bfc None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:30.455879 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f60f8-8bde-4bc0-8b1f-d61f6fc46bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:30.488397 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-864f60f8-8bde-4bc0-8b1f-d61f6fc46bfc None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:30.489661 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-864f60f8-8bde-4bc0-8b1f-d61f6fc46bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:30.520907 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b9d20-e5ce-478a-87a7-25b39d3fdbe1 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:30.532472 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:30.574215 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb3f681-cb5f-47ac-9357-853f9e02936f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:30.579570 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3f681-cb5f-47ac-9357-853f9e02936f None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:30.579887 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3f681-cb5f-47ac-9357-853f9e02936f None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:30.581539 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3f681-cb5f-47ac-9357-853f9e02936f None admin] PATH_INFO: `/v3/groups/70a82f5c58b641bb8e06a2583077b27c` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:30.586231 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb3f681-cb5f-47ac-9357-853f9e02936f None admin] RBAC: Authorizing `identity:get_group(group_id=70a82f5c58b641bb8e06a2583077b27c)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:30.588825 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb3f681-cb5f-47ac-9357-853f9e02936f None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:30.595886 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 203/407] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jul 27 12:27:30 2022] GET /identity/v3/groups/70a82f5c58b641bb8e06a2583077b27c => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:30.617703 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb3f681-cb5f-47ac-9357-853f9e02936f None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:30.631692 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 205/408] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:27:30.654971 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f60f8-8bde-4bc0-8b1f-d61f6fc46bfc None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:30.716070 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:30.777686 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb3f681-cb5f-47ac-9357-853f9e02936f None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:30.814250 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f60f8-8bde-4bc0-8b1f-d61f6fc46bfc None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:30.817113 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d83ca82-86af-4f81-92c2-ef4607edf710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:30.818535 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83ca82-86af-4f81-92c2-ef4607edf710 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:30.818535 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83ca82-86af-4f81-92c2-ef4607edf710 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:30.818535 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d83ca82-86af-4f81-92c2-ef4607edf710 None admin] PATH_INFO: `/v3/projects/252e28aa3a004a2c871b20abe82e81ee` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:30.819572 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d83ca82-86af-4f81-92c2-ef4607edf710 None admin] RBAC: Authorizing `identity:get_project(project_id=252e28aa3a004a2c871b20abe82e81ee)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:30.821017 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d83ca82-86af-4f81-92c2-ef4607edf710 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:30.823097 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 204/409] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jul 27 12:27:30 2022] GET /identity/v3/projects/252e28aa3a004a2c871b20abe82e81ee => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:27:30.838631 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d83ca82-86af-4f81-92c2-ef4607edf710 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:30.864019 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fc93e-c4fd-4c43-8114-bb367cdd4c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:30.864911 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fc93e-c4fd-4c43-8114-bb367cdd4c84 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:30.865366 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fc93e-c4fd-4c43-8114-bb367cdd4c84 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:30.866387 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fc93e-c4fd-4c43-8114-bb367cdd4c84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:30.879390 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0fc93e-c4fd-4c43-8114-bb367cdd4c84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:30.885236 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-3d0fc93e-c4fd-4c43-8114-bb367cdd4c84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 12:27:30.885236 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:30.885236 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:30.885236 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:30.885236 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:30.885236 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:30.885236 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:30.885236 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:30.885236 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:30.885236 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:30.885236 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:30.885236 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:30.885236 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:30.885236 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:30.885236 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:30.885236 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:30.886160 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:30.886160 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:30.886160 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:30.886160 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:30.886160 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:30.886160 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:30.886160 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:30.886160 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:30.886160 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:30.886160 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:30.886160 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:30.886160 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:30.886160 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:30.886160 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:30.886160 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:30.886160 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:30.886976 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:30.886976 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:30.886976 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:30.886976 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:30.886976 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:30.886976 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:30.886976 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:30.886976 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:30.886976 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:30.886976 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:30.886976 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 12:27:30.886976 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:30.890392 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 206/410] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jul 27 12:27:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:30.898593 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fc93e-c4fd-4c43-8114-bb367cdd4c84 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:30.916273 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:30.990025 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d83ca82-86af-4f81-92c2-ef4607edf710 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:31.057224 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08fb27-bf2b-498d-8935-1302f46ca40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:31.058917 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08fb27-bf2b-498d-8935-1302f46ca40a None admin] REQUEST_METHOD: `PUT` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:31.059531 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08fb27-bf2b-498d-8935-1302f46ca40a None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:31.061028 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08fb27-bf2b-498d-8935-1302f46ca40a None admin] PATH_INFO: `/v3/projects/252e28aa3a004a2c871b20abe82e81ee/groups/70a82f5c58b641bb8e06a2583077b27c/roles/28c0b3a6358343c398e7df818529a952` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:31.067395 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a08fb27-bf2b-498d-8935-1302f46ca40a None admin] RBAC: Authorizing `identity:create_grant(project_id=252e28aa3a004a2c871b20abe82e81ee, group_id=70a82f5c58b641bb8e06a2583077b27c, role_id=28c0b3a6358343c398e7df818529a952)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:31.069026 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a08fb27-bf2b-498d-8935-1302f46ca40a None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:31.071938 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:31.090667 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fc93e-c4fd-4c43-8114-bb367cdd4c84 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:31.093422 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 205/411] 10.222.0.55 () {58 vars in 1442 bytes} [Wed Jul 27 12:27:30 2022] PUT /identity/v3/projects/252e28aa3a004a2c871b20abe82e81ee/groups/70a82f5c58b641bb8e06a2583077b27c/roles/28c0b3a6358343c398e7df818529a952 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 12:27:31.154637 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14522a4-f859-4ef8-8a89-90bd15fdec62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:31.155216 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14522a4-f859-4ef8-8a89-90bd15fdec62 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:31.155498 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14522a4-f859-4ef8-8a89-90bd15fdec62 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:31.155783 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14522a4-f859-4ef8-8a89-90bd15fdec62 None admin] PATH_INFO: `/v3/roles` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:31.156544 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14522a4-f859-4ef8-8a89-90bd15fdec62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:31.156853 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14522a4-f859-4ef8-8a89-90bd15fdec62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:31.158913 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14522a4-f859-4ef8-8a89-90bd15fdec62 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:31.171931 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 207/412] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:27:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:31.178118 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08fb27-bf2b-498d-8935-1302f46ca40a None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:31.320267 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08fb27-bf2b-498d-8935-1302f46ca40a None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:31.326871 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:31.379230 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a379c-1836-43a7-8ee0-6df6eed81c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:31.379890 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a379c-1836-43a7-8ee0-6df6eed81c9e None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:31.380171 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a379c-1836-43a7-8ee0-6df6eed81c9e None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:31.380447 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a379c-1836-43a7-8ee0-6df6eed81c9e None admin] PATH_INFO: `/v3/groups/824dc54828d14a54a21d6e567531f5c4` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:31.386491 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a379c-1836-43a7-8ee0-6df6eed81c9e None admin] RBAC: Authorizing `identity:get_group(group_id=824dc54828d14a54a21d6e567531f5c4)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:31.388091 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a379c-1836-43a7-8ee0-6df6eed81c9e None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:31.389819 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 206/413] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jul 27 12:27:31 2022] GET /identity/v3/groups/824dc54828d14a54a21d6e567531f5c4 => generated 229 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:31.396242 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14522a4-f859-4ef8-8a89-90bd15fdec62 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:31.530968 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14522a4-f859-4ef8-8a89-90bd15fdec62 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:31.550905 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406b63b-ea2e-4291-b649-8e8bda2ee3c4 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:31.551216 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406b63b-ea2e-4291-b649-8e8bda2ee3c4 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:31.551461 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406b63b-ea2e-4291-b649-8e8bda2ee3c4 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:31.553038 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 207/414] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:31.557894 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f097b1c-8280-453d-b567-6dd68690aa7a None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:31.558181 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f097b1c-8280-453d-b567-6dd68690aa7a None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:31.558488 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f097b1c-8280-453d-b567-6dd68690aa7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:31.568341 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894662b1-7de1-471c-aa53-c51c2afa5330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:31.569265 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894662b1-7de1-471c-aa53-c51c2afa5330 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:31.569799 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894662b1-7de1-471c-aa53-c51c2afa5330 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:31.570280 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894662b1-7de1-471c-aa53-c51c2afa5330 None admin] PATH_INFO: `/v3/projects/618eab11857d49309c9a7cb9985a7981` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:31.571658 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894662b1-7de1-471c-aa53-c51c2afa5330 None admin] RBAC: Authorizing `identity:get_project(project_id=618eab11857d49309c9a7cb9985a7981)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:31.573282 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894662b1-7de1-471c-aa53-c51c2afa5330 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:31.575457 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 208/415] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jul 27 12:27:31 2022] GET /identity/v3/projects/618eab11857d49309c9a7cb9985a7981 => generated 344 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:31.581912 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894662b1-7de1-471c-aa53-c51c2afa5330 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:31.604999 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-7f097b1c-8280-453d-b567-6dd68690aa7a None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:31.605957 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:31.606239 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-7f097b1c-8280-453d-b567-6dd68690aa7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:31.687867 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894662b1-7de1-471c-aa53-c51c2afa5330 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:31.725245 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802956aa-489a-476f-af16-3d20f3d8ecd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:31.726394 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802956aa-489a-476f-af16-3d20f3d8ecd0 None admin] REQUEST_METHOD: `PUT` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:31.726906 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802956aa-489a-476f-af16-3d20f3d8ecd0 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:31.727394 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802956aa-489a-476f-af16-3d20f3d8ecd0 None admin] PATH_INFO: `/v3/projects/618eab11857d49309c9a7cb9985a7981/groups/824dc54828d14a54a21d6e567531f5c4/roles/af00ed97066e4c72aeb6cd3d5b5d15c9` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:31.729855 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802956aa-489a-476f-af16-3d20f3d8ecd0 None admin] RBAC: Authorizing `identity:create_grant(project_id=618eab11857d49309c9a7cb9985a7981, group_id=824dc54828d14a54a21d6e567531f5c4, role_id=af00ed97066e4c72aeb6cd3d5b5d15c9)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:31.731648 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802956aa-489a-476f-af16-3d20f3d8ecd0 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:31.749824 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 209/416] 10.222.0.55 () {58 vars in 1442 bytes} [Wed Jul 27 12:27:31 2022] PUT /identity/v3/projects/618eab11857d49309c9a7cb9985a7981/groups/824dc54828d14a54a21d6e567531f5c4/roles/af00ed97066e4c72aeb6cd3d5b5d15c9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 12:27:31.787654 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 208/417] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:27:31.824083 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802956aa-489a-476f-af16-3d20f3d8ecd0 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:31.921214 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:31.935230 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4535408-db00-476e-a174-a3517788a419 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:31.935566 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4535408-db00-476e-a174-a3517788a419 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:31.935832 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4535408-db00-476e-a174-a3517788a419 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:31.937769 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 209/418] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:31.943275 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398ab82-fff9-4012-b106-c8b4189c5532 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:31.943683 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398ab82-fff9-4012-b106-c8b4189c5532 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:31.944066 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398ab82-fff9-4012-b106-c8b4189c5532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:31.950129 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802956aa-489a-476f-af16-3d20f3d8ecd0 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:31.969546 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-1398ab82-fff9-4012-b106-c8b4189c5532 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:31.970960 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-1398ab82-fff9-4012-b106-c8b4189c5532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:31.992048 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655ca39-56e5-45fc-98a6-4497fbd978ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:31.992735 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655ca39-56e5-45fc-98a6-4497fbd978ce None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:31.993384 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655ca39-56e5-45fc-98a6-4497fbd978ce None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:31.993694 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9655ca39-56e5-45fc-98a6-4497fbd978ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:32.008584 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9655ca39-56e5-45fc-98a6-4497fbd978ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:32.014892 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-9655ca39-56e5-45fc-98a6-4497fbd978ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 12:27:32.014892 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:32.014892 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:32.014892 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:32.014892 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:32.014892 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:32.014892 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:32.014892 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:32.014892 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:32.014892 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:32.014892 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:32.014892 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:32.014892 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:32.014892 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:32.014892 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:32.014892 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:32.015798 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:32.015798 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:32.015798 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:32.015798 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:32.015798 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:32.015798 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:32.015798 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:32.015798 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:32.015798 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:32.015798 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:32.015798 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:32.015798 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:32.015798 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:32.015798 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:32.015798 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:32.015798 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:32.016661 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:32.016661 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:32.016661 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:32.016661 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:32.016661 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:32.016661 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:32.016661 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:32.016661 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:32.016661 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:32.016661 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:32.016661 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 12:27:32.016661 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:32.016661 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 210/419] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:27:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:32.021991 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655ca39-56e5-45fc-98a6-4497fbd978ce None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:32.053289 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 210/420] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:27:32.087591 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398ab82-fff9-4012-b106-c8b4189c5532 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:32.132376 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:32.190932 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9655ca39-56e5-45fc-98a6-4497fbd978ce None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:32.243049 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b5e43-ac88-4f9b-b1aa-12409efe5759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:32.243677 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b5e43-ac88-4f9b-b1aa-12409efe5759 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:32.243961 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b5e43-ac88-4f9b-b1aa-12409efe5759 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:32.244242 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b5e43-ac88-4f9b-b1aa-12409efe5759 None admin] PATH_INFO: `/v3/roles` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:32.244962 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96b5e43-ac88-4f9b-b1aa-12409efe5759 None admin] RBAC: Adding query filter params (name=member) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:32.245324 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96b5e43-ac88-4f9b-b1aa-12409efe5759 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:32.248065 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96b5e43-ac88-4f9b-b1aa-12409efe5759 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:32.253538 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:32.259721 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 211/421] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jul 27 12:27:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:32.265807 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b5e43-ac88-4f9b-b1aa-12409efe5759 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:32.280980 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398ab82-fff9-4012-b106-c8b4189c5532 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:32.366953 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ebf04-ae64-43f3-8895-5c1c316e931e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:32.367552 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ebf04-ae64-43f3-8895-5c1c316e931e None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:32.367835 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ebf04-ae64-43f3-8895-5c1c316e931e None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:32.368126 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ebf04-ae64-43f3-8895-5c1c316e931e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:32.392148 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b5e43-ac88-4f9b-b1aa-12409efe5759 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:32.402201 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ebf04-ae64-43f3-8895-5c1c316e931e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:32.407948 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-599ebf04-ae64-43f3-8895-5c1c316e931e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 12:27:32.407948 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:32.407948 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:32.407948 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:32.407948 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:32.407948 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:32.407948 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:32.407948 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:32.407948 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:32.407948 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:32.407948 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:32.407948 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:32.407948 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:32.407948 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:32.407948 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:32.407948 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:32.408874 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:32.408874 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:32.408874 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:32.408874 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:32.408874 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:32.408874 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:32.408874 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:32.408874 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:32.408874 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:32.408874 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:32.408874 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:32.408874 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:32.408874 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:32.408874 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:32.408874 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:32.408874 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:32.409721 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:32.409721 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:32.409721 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:32.409721 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:32.409721 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:32.409721 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:32.409721 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:32.409721 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:32.409721 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:32.409721 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:32.409721 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 12:27:32.409721 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:32.409721 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 211/422] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jul 27 12:27:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 12:27:32.414771 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ebf04-ae64-43f3-8895-5c1c316e931e None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:32.430861 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78fb54-c546-4436-872d-9d3100ffce92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:32.431484 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78fb54-c546-4436-872d-9d3100ffce92 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:32.431771 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78fb54-c546-4436-872d-9d3100ffce92 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:32.432048 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78fb54-c546-4436-872d-9d3100ffce92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:32.505436 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:32.509863 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd78fb54-c546-4436-872d-9d3100ffce92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:32.511323 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd78fb54-c546-4436-872d-9d3100ffce92 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:32.624354 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 212/423] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jul 27 12:27:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 12:27:32.627179 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78fb54-c546-4436-872d-9d3100ffce92 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:32.688250 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:32.704728 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ebf04-ae64-43f3-8895-5c1c316e931e None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:32.774418 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52c7f9-f4fd-4af7-bc5c-86133cf3aed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:32.775061 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52c7f9-f4fd-4af7-bc5c-86133cf3aed7 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:32.775346 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52c7f9-f4fd-4af7-bc5c-86133cf3aed7 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:32.775626 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52c7f9-f4fd-4af7-bc5c-86133cf3aed7 None admin] PATH_INFO: `/v3/roles` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:32.776465 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52c7f9-f4fd-4af7-bc5c-86133cf3aed7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:32.776774 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52c7f9-f4fd-4af7-bc5c-86133cf3aed7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:32.778284 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52c7f9-f4fd-4af7-bc5c-86133cf3aed7 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:32.793521 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78fb54-c546-4436-872d-9d3100ffce92 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:32.795378 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:32.797967 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 212/424] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jul 27 12:27:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:27:32.804306 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52c7f9-f4fd-4af7-bc5c-86133cf3aed7 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:32.832787 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a589e-80a7-46ba-bbfe-5fcd2ed53150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:32.833439 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a589e-80a7-46ba-bbfe-5fcd2ed53150 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:32.833758 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a589e-80a7-46ba-bbfe-5fcd2ed53150 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:32.834187 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a589e-80a7-46ba-bbfe-5fcd2ed53150 None admin] PATH_INFO: `/v3/projects/66779a17edc9443c8c1afeca9d6f3b11` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:32.835616 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a589e-80a7-46ba-bbfe-5fcd2ed53150 None admin] RBAC: Authorizing `identity:get_project(project_id=66779a17edc9443c8c1afeca9d6f3b11)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:32.837036 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a589e-80a7-46ba-bbfe-5fcd2ed53150 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:32.839692 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 213/425] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jul 27 12:27:32 2022] GET /identity/v3/projects/66779a17edc9443c8c1afeca9d6f3b11 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:32.846657 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a589e-80a7-46ba-bbfe-5fcd2ed53150 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:32.953697 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a589e-80a7-46ba-bbfe-5fcd2ed53150 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:33.022484 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1698f9-f20a-48a0-9e27-4fbfac3c0259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:33.023137 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1698f9-f20a-48a0-9e27-4fbfac3c0259 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:33.023417 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1698f9-f20a-48a0-9e27-4fbfac3c0259 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:33.023689 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1698f9-f20a-48a0-9e27-4fbfac3c0259 None admin] PATH_INFO: `/v3/groups/70a82f5c58b641bb8e06a2583077b27c` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:33.025974 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1698f9-f20a-48a0-9e27-4fbfac3c0259 None admin] RBAC: Authorizing `identity:get_group(group_id=70a82f5c58b641bb8e06a2583077b27c)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:33.027411 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1698f9-f20a-48a0-9e27-4fbfac3c0259 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:33.036241 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 214/426] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jul 27 12:27:32 2022] GET /identity/v3/groups/70a82f5c58b641bb8e06a2583077b27c => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:33.047068 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1698f9-f20a-48a0-9e27-4fbfac3c0259 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:33.072786 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52c7f9-f4fd-4af7-bc5c-86133cf3aed7 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:33.117994 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:33.142999 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d08416-e462-4060-97e6-69c6fe853603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:33.143624 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d08416-e462-4060-97e6-69c6fe853603 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:33.143903 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d08416-e462-4060-97e6-69c6fe853603 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:33.144175 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d08416-e462-4060-97e6-69c6fe853603 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:33.172893 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:33.219317 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1698f9-f20a-48a0-9e27-4fbfac3c0259 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:33.223112 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d08416-e462-4060-97e6-69c6fe853603 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:33.224576 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d08416-e462-4060-97e6-69c6fe853603 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:33.265729 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5aeac-a638-4a44-be80-4b7fadba76ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:33.266356 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5aeac-a638-4a44-be80-4b7fadba76ca None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:33.267188 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5aeac-a638-4a44-be80-4b7fadba76ca None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:33.267467 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5aeac-a638-4a44-be80-4b7fadba76ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:33.268257 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd5aeac-a638-4a44-be80-4b7fadba76ca None admin] RBAC: Adding query filter params (group.id=70a82f5c58b641bb8e06a2583077b27c, role.id=2136377433854360927c578b39f16e6f, scope.project.id=66779a17edc9443c8c1afeca9d6f3b11) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:33.268566 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd5aeac-a638-4a44-be80-4b7fadba76ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:33.270163 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd5aeac-a638-4a44-be80-4b7fadba76ca None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:33.277066 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 215/427] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Jul 27 12:27:33 2022] GET /identity/v3/role_assignments?group.id=70a82f5c58b641bb8e06a2583077b27c&scope.project.id=66779a17edc9443c8c1afeca9d6f3b11&role.id=2136377433854360927c578b39f16e6f => generated 611 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:27:33.278397 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339261d0-8fde-4fcf-908e-10dcaac6f1a7 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:33.278701 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339261d0-8fde-4fcf-908e-10dcaac6f1a7 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:33.278978 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339261d0-8fde-4fcf-908e-10dcaac6f1a7 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:33.280573 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 216/428] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:33.287040 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc62ca6-892b-4745-a4b2-ab1a0b375ed6 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:33.287582 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc62ca6-892b-4745-a4b2-ab1a0b375ed6 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:33.288008 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc62ca6-892b-4745-a4b2-ab1a0b375ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:33.307970 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-edc62ca6-892b-4745-a4b2-ab1a0b375ed6 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:33.309397 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-edc62ca6-892b-4745-a4b2-ab1a0b375ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:33.404752 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 213/429] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jul 27 12:27:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 12:27:33.411954 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d08416-e462-4060-97e6-69c6fe853603 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:33.421747 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 217/430] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:27:33.451219 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc62ca6-892b-4745-a4b2-ab1a0b375ed6 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:33.491553 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:33.528722 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:33.594707 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d08416-e462-4060-97e6-69c6fe853603 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:33.595743 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc62ca6-892b-4745-a4b2-ab1a0b375ed6 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:33.634610 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560a99d-0404-4df9-899c-4eaf27ce3c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:33.635361 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560a99d-0404-4df9-899c-4eaf27ce3c21 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:33.635653 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560a99d-0404-4df9-899c-4eaf27ce3c21 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:33.635932 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560a99d-0404-4df9-899c-4eaf27ce3c21 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:33.638496 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d57bf-4222-42ec-a6e4-b565a78db7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:33.639469 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d57bf-4222-42ec-a6e4-b565a78db7b6 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:33.639972 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d57bf-4222-42ec-a6e4-b565a78db7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:33.640448 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d57bf-4222-42ec-a6e4-b565a78db7b6 None admin] PATH_INFO: `/v3/projects/66779a17edc9443c8c1afeca9d6f3b11` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:33.642894 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98d57bf-4222-42ec-a6e4-b565a78db7b6 None admin] RBAC: Authorizing `identity:get_project(project_id=66779a17edc9443c8c1afeca9d6f3b11)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:33.644815 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98d57bf-4222-42ec-a6e4-b565a78db7b6 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:33.647029 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 214/431] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jul 27 12:27:33 2022] GET /identity/v3/projects/66779a17edc9443c8c1afeca9d6f3b11 => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:27:33.647678 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560a99d-0404-4df9-899c-4eaf27ce3c21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:33.652850 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-0560a99d-0404-4df9-899c-4eaf27ce3c21 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 12:27:33.652850 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:33.652850 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:33.652850 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:33.652850 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:33.652850 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:33.652850 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:33.652850 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:33.652850 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:33.652850 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:33.652850 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:33.652850 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:33.652850 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:33.652850 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:33.652850 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:33.652850 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:33.653766 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:33.653766 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:33.653766 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:33.653766 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:33.653766 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:33.653766 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:33.653766 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:33.653766 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:33.653766 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:33.653766 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:33.653766 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:33.653766 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:33.653766 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:33.653766 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:33.653766 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:33.653766 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:33.654571 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:33.654571 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:33.654571 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:33.654571 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:33.654571 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:33.654571 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:33.654571 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:33.654571 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:33.654571 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:33.654571 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:33.654571 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 12:27:33.654571 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:33.655204 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d57bf-4222-42ec-a6e4-b565a78db7b6 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:33.655286 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 218/432] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:27:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 12:27:33.663188 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560a99d-0404-4df9-899c-4eaf27ce3c21 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:33.764927 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:33.777721 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560a99d-0404-4df9-899c-4eaf27ce3c21 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:33.782307 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d57bf-4222-42ec-a6e4-b565a78db7b6 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:33.816736 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e6e78-95b0-4ca4-94db-7e8716b357e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:33.817116 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e6e78-95b0-4ca4-94db-7e8716b357e8 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:33.817406 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e6e78-95b0-4ca4-94db-7e8716b357e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:33.817708 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e6e78-95b0-4ca4-94db-7e8716b357e8 None admin] PATH_INFO: `/v3/roles` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:33.818433 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e6e78-95b0-4ca4-94db-7e8716b357e8 None admin] RBAC: Adding query filter params (name=member) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:33.818817 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e6e78-95b0-4ca4-94db-7e8716b357e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:33.821715 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e6e78-95b0-4ca4-94db-7e8716b357e8 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:33.821841 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:33.825407 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8c788-9adc-41b3-8b57-9d3452f81734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:33.826355 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8c788-9adc-41b3-8b57-9d3452f81734 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:33.826907 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8c788-9adc-41b3-8b57-9d3452f81734 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:33.827387 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8c788-9adc-41b3-8b57-9d3452f81734 None admin] PATH_INFO: `/v3/groups/70a82f5c58b641bb8e06a2583077b27c` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:33.828784 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f8c788-9adc-41b3-8b57-9d3452f81734 None admin] RBAC: Authorizing `identity:get_group(group_id=70a82f5c58b641bb8e06a2583077b27c)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:33.831088 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 219/433] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jul 27 12:27:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:33.831278 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f8c788-9adc-41b3-8b57-9d3452f81734 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:33.833014 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 215/434] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jul 27 12:27:33 2022] GET /identity/v3/groups/70a82f5c58b641bb8e06a2583077b27c => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:33.839618 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e6e78-95b0-4ca4-94db-7e8716b357e8 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:33.839768 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8c788-9adc-41b3-8b57-9d3452f81734 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:33.964452 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e6e78-95b0-4ca4-94db-7e8716b357e8 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:33.969789 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8c788-9adc-41b3-8b57-9d3452f81734 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:34.014080 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb291c-11f7-4ccf-af0a-caabc9463ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:34.014780 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f255ce2-379f-4625-a435-faacd9f80538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:34.014996 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb291c-11f7-4ccf-af0a-caabc9463ac1 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:34.015337 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb291c-11f7-4ccf-af0a-caabc9463ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:34.015461 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f255ce2-379f-4625-a435-faacd9f80538 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:34.015676 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f255ce2-379f-4625-a435-faacd9f80538 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:34.015862 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb291c-11f7-4ccf-af0a-caabc9463ac1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:34.015985 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f255ce2-379f-4625-a435-faacd9f80538 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:34.017311 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f255ce2-379f-4625-a435-faacd9f80538 None admin] RBAC: Adding query filter params (group.id=70a82f5c58b641bb8e06a2583077b27c, role.id=28c0b3a6358343c398e7df818529a952, scope.project.id=66779a17edc9443c8c1afeca9d6f3b11) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:34.017644 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f255ce2-379f-4625-a435-faacd9f80538 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:34.019101 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f255ce2-379f-4625-a435-faacd9f80538 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:34.026212 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 216/435] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Jul 27 12:27:33 2022] GET /identity/v3/role_assignments?group.id=70a82f5c58b641bb8e06a2583077b27c&scope.project.id=66779a17edc9443c8c1afeca9d6f3b11&role.id=28c0b3a6358343c398e7df818529a952 => generated 611 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:34.027462 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e41b4-09a0-4093-8fc4-15682fb29d61 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:34.027751 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e41b4-09a0-4093-8fc4-15682fb29d61 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:34.028153 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e41b4-09a0-4093-8fc4-15682fb29d61 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:34.029571 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 217/436] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:34.035143 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9422b8-4c67-4183-bdba-ee67955a63a8 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:34.035428 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9422b8-4c67-4183-bdba-ee67955a63a8 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:34.035711 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9422b8-4c67-4183-bdba-ee67955a63a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:34.041805 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:34.056893 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-0a9422b8-4c67-4183-bdba-ee67955a63a8 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:34.058271 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-0a9422b8-4c67-4183-bdba-ee67955a63a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:34.097634 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb291c-11f7-4ccf-af0a-caabc9463ac1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:34.099202 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb291c-11f7-4ccf-af0a-caabc9463ac1 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:34.118642 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:34.139768 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 218/437] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 12:27:34.167265 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9422b8-4c67-4183-bdba-ee67955a63a8 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:34.238405 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 220/438] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jul 27 12:27:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 12:27:34.246194 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb291c-11f7-4ccf-af0a-caabc9463ac1 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:34.302496 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9422b8-4c67-4183-bdba-ee67955a63a8 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:34.326607 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:34.353248 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49eb0a5-e857-4233-89d9-d315e79a1b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:34.354794 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49eb0a5-e857-4233-89d9-d315e79a1b74 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:34.355132 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49eb0a5-e857-4233-89d9-d315e79a1b74 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:34.355361 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49eb0a5-e857-4233-89d9-d315e79a1b74 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:34.368251 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49eb0a5-e857-4233-89d9-d315e79a1b74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:34.374166 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-e49eb0a5-e857-4233-89d9-d315e79a1b74 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 12:27:34.374166 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:34.374166 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:34.374166 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:34.374166 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:34.374166 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:34.374166 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:34.374166 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:34.374166 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:34.374166 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:34.374166 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:34.374166 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:34.374166 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:34.374166 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:34.374166 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:34.374166 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:34.375045 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:34.375045 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:34.375045 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:34.375045 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:34.375045 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:34.375045 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:34.375045 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:34.375045 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:34.375045 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:34.375045 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:34.375045 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:34.375045 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:34.375045 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:34.375045 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:34.375045 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:34.375045 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:34.375932 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:34.375932 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:34.375932 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:34.375932 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:34.375932 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:34.375932 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:34.375932 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:34.375932 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:34.375932 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:34.375932 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:34.375932 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 12:27:34.375932 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:34.377059 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 219/439] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jul 27 12:27:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 12:27:34.383328 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49eb0a5-e857-4233-89d9-d315e79a1b74 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:34.395559 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb291c-11f7-4ccf-af0a-caabc9463ac1 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:34.445274 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:34.448372 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b55078-cee0-4cc9-ac44-fd11ecabb351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:34.448999 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b55078-cee0-4cc9-ac44-fd11ecabb351 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:34.449281 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b55078-cee0-4cc9-ac44-fd11ecabb351 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:34.449552 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b55078-cee0-4cc9-ac44-fd11ecabb351 None admin] PATH_INFO: `/v3/projects/252e28aa3a004a2c871b20abe82e81ee` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:34.450866 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b55078-cee0-4cc9-ac44-fd11ecabb351 None admin] RBAC: Authorizing `identity:get_project(project_id=252e28aa3a004a2c871b20abe82e81ee)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:34.452310 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b55078-cee0-4cc9-ac44-fd11ecabb351 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:34.454343 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 221/440] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jul 27 12:27:34 2022] GET /identity/v3/projects/252e28aa3a004a2c871b20abe82e81ee => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:34.461307 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b55078-cee0-4cc9-ac44-fd11ecabb351 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:34.516393 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49eb0a5-e857-4233-89d9-d315e79a1b74 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:34.554204 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4362d7c-34ff-4d79-a0b6-fcb5598b5f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:34.554756 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4362d7c-34ff-4d79-a0b6-fcb5598b5f1d None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:34.555040 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4362d7c-34ff-4d79-a0b6-fcb5598b5f1d None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:34.555316 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4362d7c-34ff-4d79-a0b6-fcb5598b5f1d None admin] PATH_INFO: `/v3/roles` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:34.556038 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4362d7c-34ff-4d79-a0b6-fcb5598b5f1d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:34.556343 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4362d7c-34ff-4d79-a0b6-fcb5598b5f1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:34.558200 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4362d7c-34ff-4d79-a0b6-fcb5598b5f1d None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:34.566310 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 220/441] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jul 27 12:27:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:34.566310 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ed438-19b4-4123-aeeb-fea205c736d7 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:34.566310 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ed438-19b4-4123-aeeb-fea205c736d7 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:34.566310 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ed438-19b4-4123-aeeb-fea205c736d7 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:34.566310 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 221/442] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:34.574253 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ed438-19b4-4123-aeeb-fea205c736d7 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:34.585630 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b55078-cee0-4cc9-ac44-fd11ecabb351 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:34.605565 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:34.625314 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7c7cd-422c-4e33-95c7-3bf84f0333a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:34.626051 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7c7cd-422c-4e33-95c7-3bf84f0333a0 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:34.626358 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7c7cd-422c-4e33-95c7-3bf84f0333a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:34.626661 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7c7cd-422c-4e33-95c7-3bf84f0333a0 None admin] PATH_INFO: `/v3/groups/70a82f5c58b641bb8e06a2583077b27c` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:34.627852 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7c7cd-422c-4e33-95c7-3bf84f0333a0 None admin] RBAC: Authorizing `identity:get_group(group_id=70a82f5c58b641bb8e06a2583077b27c)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:34.629280 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7c7cd-422c-4e33-95c7-3bf84f0333a0 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:34.631088 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 222/443] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jul 27 12:27:34 2022] GET /identity/v3/groups/70a82f5c58b641bb8e06a2583077b27c => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:27:34.632473 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ae423-b595-415a-b2a4-2bf7d4333608 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:34.632756 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ae423-b595-415a-b2a4-2bf7d4333608 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:34.633030 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ae423-b595-415a-b2a4-2bf7d4333608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:34.650651 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-1b8ae423-b595-415a-b2a4-2bf7d4333608 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:34.651831 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-1b8ae423-b595-415a-b2a4-2bf7d4333608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:34.689697 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ed438-19b4-4123-aeeb-fea205c736d7 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:34.697370 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:34.728222 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 223/444] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:27:34.729223 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ae423-b595-415a-b2a4-2bf7d4333608 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:34.744556 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af673a54-2039-4005-8df8-8f210eca5ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:34.745193 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af673a54-2039-4005-8df8-8f210eca5ed9 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:34.745471 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af673a54-2039-4005-8df8-8f210eca5ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:34.745774 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af673a54-2039-4005-8df8-8f210eca5ed9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:34.812934 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af673a54-2039-4005-8df8-8f210eca5ed9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:34.814363 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af673a54-2039-4005-8df8-8f210eca5ed9 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:34.829513 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ae423-b595-415a-b2a4-2bf7d4333608 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:34.847826 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:34.866461 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc7a64-25c0-433d-855c-a2eb1194ec84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:34.867075 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc7a64-25c0-433d-855c-a2eb1194ec84 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:34.867350 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc7a64-25c0-433d-855c-a2eb1194ec84 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:34.867625 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc7a64-25c0-433d-855c-a2eb1194ec84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:34.868401 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdc7a64-25c0-433d-855c-a2eb1194ec84 None admin] RBAC: Adding query filter params (group.id=70a82f5c58b641bb8e06a2583077b27c, role.id=2136377433854360927c578b39f16e6f, scope.project.id=252e28aa3a004a2c871b20abe82e81ee) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:34.868707 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdc7a64-25c0-433d-855c-a2eb1194ec84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:34.870143 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdc7a64-25c0-433d-855c-a2eb1194ec84 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:34.875955 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 224/445] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Jul 27 12:27:34 2022] GET /identity/v3/role_assignments?group.id=70a82f5c58b641bb8e06a2583077b27c&scope.project.id=252e28aa3a004a2c871b20abe82e81ee&role.id=2136377433854360927c578b39f16e6f => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:34.876500 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc7a64-25c0-433d-855c-a2eb1194ec84 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:34.918335 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 222/446] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jul 27 12:27:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 12:27:34.924442 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af673a54-2039-4005-8df8-8f210eca5ed9 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:34.932921 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:34.998587 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc7a64-25c0-433d-855c-a2eb1194ec84 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:35.036572 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b79bc-6d14-4244-8024-65609f5b4533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:35.037227 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b79bc-6d14-4244-8024-65609f5b4533 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:35.037394 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af673a54-2039-4005-8df8-8f210eca5ed9 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:35.037491 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b79bc-6d14-4244-8024-65609f5b4533 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:35.037797 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b79bc-6d14-4244-8024-65609f5b4533 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:35.055093 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b79bc-6d14-4244-8024-65609f5b4533 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:35.061245 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-488b79bc-6d14-4244-8024-65609f5b4533 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 12:27:35.061245 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:35.061245 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:35.061245 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:35.061245 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:35.061245 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:35.061245 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:35.061245 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:35.061245 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:35.061245 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:35.061245 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:35.061245 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:35.061245 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:35.061245 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:35.061245 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:35.061245 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:35.062249 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:35.062249 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:35.062249 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:35.062249 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:35.062249 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:35.062249 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:35.062249 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:35.062249 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:35.062249 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:35.062249 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:35.062249 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:35.062249 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:35.062249 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:35.062249 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:35.062249 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:35.062249 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:35.063415 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:35.063415 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:35.063415 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:35.063415 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:35.063415 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:35.063415 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:35.063415 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:35.063415 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:35.063415 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:35.063415 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:35.063415 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 12:27:35.063415 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:35.063415 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 225/447] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jul 27 12:27:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:35.069642 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b79bc-6d14-4244-8024-65609f5b4533 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:35.087494 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e577bb-6ff6-47dd-9528-aefe5ceda914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:35.088265 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e577bb-6ff6-47dd-9528-aefe5ceda914 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:35.088422 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e577bb-6ff6-47dd-9528-aefe5ceda914 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:35.088700 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e577bb-6ff6-47dd-9528-aefe5ceda914 None admin] PATH_INFO: `/v3/projects/252e28aa3a004a2c871b20abe82e81ee` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:35.090094 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e577bb-6ff6-47dd-9528-aefe5ceda914 None admin] RBAC: Authorizing `identity:get_project(project_id=252e28aa3a004a2c871b20abe82e81ee)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:35.091360 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e577bb-6ff6-47dd-9528-aefe5ceda914 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:35.093351 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 223/448] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jul 27 12:27:34 2022] GET /identity/v3/projects/252e28aa3a004a2c871b20abe82e81ee => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:27:35.098578 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e577bb-6ff6-47dd-9528-aefe5ceda914 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:35.117027 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:35.188422 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b79bc-6d14-4244-8024-65609f5b4533 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:35.197312 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:35.228839 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad9dc3-586c-4735-b499-3aef03df14b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:35.229723 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad9dc3-586c-4735-b499-3aef03df14b8 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:35.230073 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e577bb-6ff6-47dd-9528-aefe5ceda914 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:35.230298 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad9dc3-586c-4735-b499-3aef03df14b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:35.230737 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad9dc3-586c-4735-b499-3aef03df14b8 None admin] PATH_INFO: `/v3/roles` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:35.231607 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad9dc3-586c-4735-b499-3aef03df14b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:35.231911 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad9dc3-586c-4735-b499-3aef03df14b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:35.233270 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad9dc3-586c-4735-b499-3aef03df14b8 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:35.243045 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 226/449] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:27:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:27:35.248688 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad9dc3-586c-4735-b499-3aef03df14b8 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:35.269444 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3460f-db1d-4fca-b29c-e5221f4a4eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:35.270130 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3460f-db1d-4fca-b29c-e5221f4a4eba None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:35.270408 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3460f-db1d-4fca-b29c-e5221f4a4eba None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:35.270685 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3460f-db1d-4fca-b29c-e5221f4a4eba None admin] PATH_INFO: `/v3/groups/70a82f5c58b641bb8e06a2583077b27c` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:35.271846 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c3460f-db1d-4fca-b29c-e5221f4a4eba None admin] RBAC: Authorizing `identity:get_group(group_id=70a82f5c58b641bb8e06a2583077b27c)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:35.273287 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c3460f-db1d-4fca-b29c-e5221f4a4eba None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:35.274923 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 224/450] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jul 27 12:27:35 2022] GET /identity/v3/groups/70a82f5c58b641bb8e06a2583077b27c => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:27:35.280775 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3460f-db1d-4fca-b29c-e5221f4a4eba None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:35.353623 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad9dc3-586c-4735-b499-3aef03df14b8 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:35.355845 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:35.386218 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3460f-db1d-4fca-b29c-e5221f4a4eba None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:35.389972 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8e7b2-b6fc-46cd-b8a0-1b4e6e2b0eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:35.390648 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8e7b2-b6fc-46cd-b8a0-1b4e6e2b0eb2 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:35.390937 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8e7b2-b6fc-46cd-b8a0-1b4e6e2b0eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:35.391235 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8e7b2-b6fc-46cd-b8a0-1b4e6e2b0eb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:35.439202 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d874f-87cf-45ec-a6f0-337e83c39b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:35.439882 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d874f-87cf-45ec-a6f0-337e83c39b42 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:35.440174 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d874f-87cf-45ec-a6f0-337e83c39b42 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:35.440478 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d874f-87cf-45ec-a6f0-337e83c39b42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:35.441270 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d874f-87cf-45ec-a6f0-337e83c39b42 None admin] RBAC: Adding query filter params (group.id=70a82f5c58b641bb8e06a2583077b27c, role.id=28c0b3a6358343c398e7df818529a952, scope.project.id=252e28aa3a004a2c871b20abe82e81ee) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:35.441582 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d874f-87cf-45ec-a6f0-337e83c39b42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:35.443048 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d874f-87cf-45ec-a6f0-337e83c39b42 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:35.448936 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 225/451] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Jul 27 12:27:35 2022] GET /identity/v3/role_assignments?group.id=70a82f5c58b641bb8e06a2583077b27c&scope.project.id=252e28aa3a004a2c871b20abe82e81ee&role.id=28c0b3a6358343c398e7df818529a952 => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:27:35.464733 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8e7b2-b6fc-46cd-b8a0-1b4e6e2b0eb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:35.466261 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8e7b2-b6fc-46cd-b8a0-1b4e6e2b0eb2 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:35.571734 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 227/452] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jul 27 12:27:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 12:27:35.577694 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d874f-87cf-45ec-a6f0-337e83c39b42 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:35.586776 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:35.689355 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d874f-87cf-45ec-a6f0-337e83c39b42 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:35.723252 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dba36a-035a-4869-8825-d0a02f1fa66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:35.723895 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dba36a-035a-4869-8825-d0a02f1fa66e None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:35.724177 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dba36a-035a-4869-8825-d0a02f1fa66e None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:35.724452 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dba36a-035a-4869-8825-d0a02f1fa66e None admin] PATH_INFO: `/v3/projects/618eab11857d49309c9a7cb9985a7981` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:35.725636 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dba36a-035a-4869-8825-d0a02f1fa66e None admin] RBAC: Authorizing `identity:get_project(project_id=618eab11857d49309c9a7cb9985a7981)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:35.727207 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dba36a-035a-4869-8825-d0a02f1fa66e None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:35.728859 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 226/453] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Jul 27 12:27:35 2022] GET /identity/v3/projects/618eab11857d49309c9a7cb9985a7981 => generated 344 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:35.734456 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8e7b2-b6fc-46cd-b8a0-1b4e6e2b0eb2 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:35.737707 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:35.833421 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8e7b2-b6fc-46cd-b8a0-1b4e6e2b0eb2 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:35.865970 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de866fe9-e83a-42b4-93c2-6558ca09326a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:35.866599 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de866fe9-e83a-42b4-93c2-6558ca09326a None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:35.866878 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de866fe9-e83a-42b4-93c2-6558ca09326a None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:35.867153 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de866fe9-e83a-42b4-93c2-6558ca09326a None admin] PATH_INFO: `/v3/groups/824dc54828d14a54a21d6e567531f5c4` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:35.868277 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de866fe9-e83a-42b4-93c2-6558ca09326a None admin] RBAC: Authorizing `identity:get_group(group_id=824dc54828d14a54a21d6e567531f5c4)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:35.869770 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de866fe9-e83a-42b4-93c2-6558ca09326a None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:35.871335 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 228/454] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Jul 27 12:27:35 2022] GET /identity/v3/groups/824dc54828d14a54a21d6e567531f5c4 => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:35.877365 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dba36a-035a-4869-8825-d0a02f1fa66e None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:35.949944 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:35.975335 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dba36a-035a-4869-8825-d0a02f1fa66e None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:36.008008 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee86c4-4fa0-4642-bc64-cff252e5374e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:36.008614 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee86c4-4fa0-4642-bc64-cff252e5374e None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:36.008899 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee86c4-4fa0-4642-bc64-cff252e5374e None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:36.009179 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee86c4-4fa0-4642-bc64-cff252e5374e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:36.009991 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ee86c4-4fa0-4642-bc64-cff252e5374e None admin] RBAC: Adding query filter params (group.id=824dc54828d14a54a21d6e567531f5c4, role.id=af00ed97066e4c72aeb6cd3d5b5d15c9, scope.project.id=618eab11857d49309c9a7cb9985a7981) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:36.010304 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ee86c4-4fa0-4642-bc64-cff252e5374e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:36.011735 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ee86c4-4fa0-4642-bc64-cff252e5374e None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:36.017927 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 227/455] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Jul 27 12:27:35 2022] GET /identity/v3/role_assignments?group.id=824dc54828d14a54a21d6e567531f5c4&scope.project.id=618eab11857d49309c9a7cb9985a7981&role.id=af00ed97066e4c72aeb6cd3d5b5d15c9 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:38.585246 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02140a09-c25b-4aae-bd27-8ee8b280c231 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:38.586304 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02140a09-c25b-4aae-bd27-8ee8b280c231 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:38.586802 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02140a09-c25b-4aae-bd27-8ee8b280c231 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:38.588677 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 229/456] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:38.594032 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b7835-918f-44bb-b875-444694bbfd9d None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:38.595441 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b7835-918f-44bb-b875-444694bbfd9d None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:38.595932 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b7835-918f-44bb-b875-444694bbfd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:38.615261 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-b13b7835-918f-44bb-b875-444694bbfd9d None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:38.617135 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-b13b7835-918f-44bb-b875-444694bbfd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:38.646275 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063000d-5f2c-4aa4-994f-1f4f4e7f2be2 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:38.646538 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063000d-5f2c-4aa4-994f-1f4f4e7f2be2 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:38.646917 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063000d-5f2c-4aa4-994f-1f4f4e7f2be2 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:38.648608 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 230/457] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:38.655383 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcbd95-9d42-450f-980b-115d443e0698 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:38.655699 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcbd95-9d42-450f-980b-115d443e0698 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:38.655922 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcbd95-9d42-450f-980b-115d443e0698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:38.681976 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-bfbcbd95-9d42-450f-980b-115d443e0698 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:38.683112 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-bfbcbd95-9d42-450f-980b-115d443e0698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:38.711668 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 228/458] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:27:38.738561 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b7835-918f-44bb-b875-444694bbfd9d None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:38.761745 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 231/459] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:27:38.789683 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbcbd95-9d42-450f-980b-115d443e0698 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:38.793938 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:38.822783 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:38.857846 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b7835-918f-44bb-b875-444694bbfd9d None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:38.892957 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9524ae15-7aad-4c7c-ac1a-93181ce66f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:38.893632 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524ae15-7aad-4c7c-ac1a-93181ce66f7e None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:38.893927 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524ae15-7aad-4c7c-ac1a-93181ce66f7e None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:38.894212 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524ae15-7aad-4c7c-ac1a-93181ce66f7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:38.904093 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9524ae15-7aad-4c7c-ac1a-93181ce66f7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:38.905551 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9524ae15-7aad-4c7c-ac1a-93181ce66f7e None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:38.906314 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbcbd95-9d42-450f-980b-115d443e0698 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:38.920783 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-9524ae15-7aad-4c7c-ac1a-93181ce66f7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:38.920783 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:38.920783 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:38.920783 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:38.920783 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:38.920783 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:38.920783 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:38.920783 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:38.920783 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:38.920783 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:38.920783 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:38.920783 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:38.920783 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:27:38.920783 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:27:38.920783 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:27:38.921897 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:27:38.921897 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:38.921897 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:38.921897 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:38.921897 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:38.921897 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:38.921897 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:38.921897 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:38.921897 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:38.921897 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:38.921897 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:38.921897 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:38.921897 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:38.921897 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:38.921897 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:38.921897 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:38.921897 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:38.922789 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:27:38.922789 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:27:38.922789 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:38.922789 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:38.922789 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 229/460] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:27:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:38.923273 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed79c9-a2cb-43a6-bd0e-ce31da0f8184 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:38.923563 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed79c9-a2cb-43a6-bd0e-ce31da0f8184 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:38.923845 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed79c9-a2cb-43a6-bd0e-ce31da0f8184 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:38.925241 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 230/461] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:38.930089 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed79c9-a2cb-43a6-bd0e-ce31da0f8184 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:38.949056 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f96363-c007-4505-acb6-0e982f7ae75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:38.950117 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f96363-c007-4505-acb6-0e982f7ae75d None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:38.950622 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f96363-c007-4505-acb6-0e982f7ae75d None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:38.951098 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f96363-c007-4505-acb6-0e982f7ae75d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:38.963648 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f96363-c007-4505-acb6-0e982f7ae75d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:38.965430 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f96363-c007-4505-acb6-0e982f7ae75d None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:38.981972 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-b6f96363-c007-4505-acb6-0e982f7ae75d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:38.981972 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:38.981972 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:38.981972 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:38.981972 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:38.981972 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:38.981972 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:38.981972 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:38.981972 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:38.981972 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:38.981972 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:38.981972 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:38.981972 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:27:38.981972 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:27:38.981972 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:27:38.983084 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:27:38.983084 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:38.983084 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:38.983084 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:38.983084 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:38.983084 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:38.983084 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:38.983084 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:38.983084 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:38.983084 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:38.983084 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:38.983084 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:38.983084 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:38.983084 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:38.983084 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:38.983084 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:38.983084 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:38.983923 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:27:38.983923 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:27:38.983923 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:38.983923 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:38.989098 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 232/462] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:27:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 12:27:38.990432 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac05bc-935b-49a4-94ff-4707b75736ea None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:38.990966 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac05bc-935b-49a4-94ff-4707b75736ea None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:38.991269 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac05bc-935b-49a4-94ff-4707b75736ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:39.010537 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-d1ac05bc-935b-49a4-94ff-4707b75736ea None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:39.011768 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-d1ac05bc-935b-49a4-94ff-4707b75736ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:39.042082 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed79c9-a2cb-43a6-bd0e-ce31da0f8184 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:39.062521 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:39.066806 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:39.080203 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a0a5f-0d05-4e8c-bd1e-132d8cccddf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:39.080831 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a0a5f-0d05-4e8c-bd1e-132d8cccddf0 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:39.081115 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a0a5f-0d05-4e8c-bd1e-132d8cccddf0 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:39.081395 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a0a5f-0d05-4e8c-bd1e-132d8cccddf0 None admin] PATH_INFO: `/v3/domains` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:39.082132 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a0a5f-0d05-4e8c-bd1e-132d8cccddf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:39.082440 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a0a5f-0d05-4e8c-bd1e-132d8cccddf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:39.083815 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a0a5f-0d05-4e8c-bd1e-132d8cccddf0 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:39.086153 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 233/463] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:27:39.097744 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac05bc-935b-49a4-94ff-4707b75736ea None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:39.106823 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 231/464] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:39.107770 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a0a5f-0d05-4e8c-bd1e-132d8cccddf0 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:39.200374 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac05bc-935b-49a4-94ff-4707b75736ea None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:39.207023 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a0a5f-0d05-4e8c-bd1e-132d8cccddf0 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:39.234308 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47170b3-dd9f-45c0-b76e-c767c6c584c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:39.234925 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47170b3-dd9f-45c0-b76e-c767c6c584c1 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:39.235235 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47170b3-dd9f-45c0-b76e-c767c6c584c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:39.235531 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47170b3-dd9f-45c0-b76e-c767c6c584c1 None admin] PATH_INFO: `/v3/domains` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:39.236223 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47170b3-dd9f-45c0-b76e-c767c6c584c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:39.236559 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47170b3-dd9f-45c0-b76e-c767c6c584c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:39.237966 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47170b3-dd9f-45c0-b76e-c767c6c584c1 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:39.240388 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e08e4-4329-425d-991e-18592349e269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:39.241259 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e08e4-4329-425d-991e-18592349e269 None admin] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:39.241539 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e08e4-4329-425d-991e-18592349e269 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:39.241845 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e08e4-4329-425d-991e-18592349e269 None admin] PATH_INFO: `/v3/users` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:39.242526 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e08e4-4329-425d-991e-18592349e269 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:39.243946 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88e08e4-4329-425d-991e-18592349e269 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:39.249256 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 234/465] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:39.250082 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47170b3-dd9f-45c0-b76e-c767c6c584c1 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:39.267638 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 232/466] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jul 27 12:27:39 2022] POST /identity/v3/users => generated 246 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 12:27:39.268950 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9761b-ef4f-4ff2-b8d3-84fc5c13bc42 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:39.269256 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9761b-ef4f-4ff2-b8d3-84fc5c13bc42 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:39.269530 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9761b-ef4f-4ff2-b8d3-84fc5c13bc42 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:39.270792 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 233/467] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:39.271503 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9761b-ef4f-4ff2-b8d3-84fc5c13bc42 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:39.311288 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:39.318145 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:39.379646 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47170b3-dd9f-45c0-b76e-c767c6c584c1 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:39.394204 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9761b-ef4f-4ff2-b8d3-84fc5c13bc42 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:39.419521 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87550617-0521-48ee-95e9-94b6fb864a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:39.420209 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87550617-0521-48ee-95e9-94b6fb864a6a None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:39.420496 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87550617-0521-48ee-95e9-94b6fb864a6a None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:39.420779 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87550617-0521-48ee-95e9-94b6fb864a6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:39.432422 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ba136-72f9-4141-b77c-dc49a0f59f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:39.433057 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ba136-72f9-4141-b77c-dc49a0f59f81 None admin] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:39.433342 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ba136-72f9-4141-b77c-dc49a0f59f81 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:39.434574 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ba136-72f9-4141-b77c-dc49a0f59f81 None admin] PATH_INFO: `/v3/users` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:39.434677 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87550617-0521-48ee-95e9-94b6fb864a6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:39.434753 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ba136-72f9-4141-b77c-dc49a0f59f81 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:39.435311 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87550617-0521-48ee-95e9-94b6fb864a6a None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:39.435748 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ba136-72f9-4141-b77c-dc49a0f59f81 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:39.451774 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-87550617-0521-48ee-95e9-94b6fb864a6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:39.451774 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:39.451774 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:39.451774 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:39.451774 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:39.451774 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:39.451774 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:39.451774 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:39.451774 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:39.451774 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:39.451774 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:39.451774 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:39.451774 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:27:39.451774 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:27:39.451774 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:27:39.452712 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:27:39.452712 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:39.452712 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:39.452712 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:39.452712 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:39.452712 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:39.452712 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:39.452712 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:39.452712 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:39.452712 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:39.452712 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:39.452712 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:39.452712 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:39.452712 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:39.452712 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:39.452712 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:39.452712 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:39.453705 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:27:39.453705 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:27:39.453705 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:39.453705 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:39.453705 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 235/468] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:27:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:39.454001 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cf7d9-d92b-4ff5-925c-c16d2906f625 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:39.454887 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cf7d9-d92b-4ff5-925c-c16d2906f625 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:39.454887 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cf7d9-d92b-4ff5-925c-c16d2906f625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:39.461799 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 234/469] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jul 27 12:27:39 2022] POST /identity/v3/users => generated 248 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 12:27:39.465722 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ba136-72f9-4141-b77c-dc49a0f59f81 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:39.480677 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-5a8cf7d9-d92b-4ff5-925c-c16d2906f625 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:39.481941 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-5a8cf7d9-d92b-4ff5-925c-c16d2906f625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:39.573363 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 236/470] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:27:39.597091 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:39.609956 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ba136-72f9-4141-b77c-dc49a0f59f81 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:39.611783 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8cf7d9-d92b-4ff5-925c-c16d2906f625 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:39.660106 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:39.661995 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b843545-9f6b-45d8-9794-bfecf23fbdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:39.662644 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b843545-9f6b-45d8-9794-bfecf23fbdec None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:39.662934 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b843545-9f6b-45d8-9794-bfecf23fbdec None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:39.663214 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b843545-9f6b-45d8-9794-bfecf23fbdec None admin] PATH_INFO: `/v3/domains` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:39.665716 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b843545-9f6b-45d8-9794-bfecf23fbdec None admin] RBAC: Adding query filter params (name=Default) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:39.665716 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b843545-9f6b-45d8-9794-bfecf23fbdec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:39.665716 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b843545-9f6b-45d8-9794-bfecf23fbdec None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:39.682809 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 235/471] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:39.689548 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b843545-9f6b-45d8-9794-bfecf23fbdec None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:39.769152 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8cf7d9-d92b-4ff5-925c-c16d2906f625 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:39.810558 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b843545-9f6b-45d8-9794-bfecf23fbdec None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:39.821706 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c22780-8774-48c8-98e4-032545d28e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:39.823164 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c22780-8774-48c8-98e4-032545d28e78 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:39.823595 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c22780-8774-48c8-98e4-032545d28e78 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:39.824422 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c22780-8774-48c8-98e4-032545d28e78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:39.839063 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c22780-8774-48c8-98e4-032545d28e78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:39.841821 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c22780-8774-48c8-98e4-032545d28e78 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:39.850456 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7dcbd7-3807-4af7-8f3d-3c9428a17c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:39.851812 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7dcbd7-3807-4af7-8f3d-3c9428a17c84 None admin] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:39.852240 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7dcbd7-3807-4af7-8f3d-3c9428a17c84 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:39.853206 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7dcbd7-3807-4af7-8f3d-3c9428a17c84 None admin] PATH_INFO: `/v3/users` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:39.854213 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7dcbd7-3807-4af7-8f3d-3c9428a17c84 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:39.855903 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7dcbd7-3807-4af7-8f3d-3c9428a17c84 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:39.859644 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-a6c22780-8774-48c8-98e4-032545d28e78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:39.859644 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:39.859644 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:39.859644 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:39.859644 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:39.859644 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:39.859644 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:39.859644 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:39.859644 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:39.859644 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:39.859644 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:39.859644 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:39.859644 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:27:39.859644 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:27:39.859644 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:27:39.861343 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:27:39.861343 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:39.861343 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:39.861343 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:39.861343 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:39.861343 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:39.861343 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:39.861343 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:39.861343 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:39.861343 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:39.861343 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:39.861343 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:39.861343 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:39.861343 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:39.861343 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:39.861343 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:39.861343 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:39.862438 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:27:39.862438 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:27:39.862438 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:39.862438 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:39.863916 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 237/472] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:27:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 12:27:39.869788 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c22780-8774-48c8-98e4-032545d28e78 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:39.888492 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 236/473] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jul 27 12:27:39 2022] POST /identity/v3/users => generated 248 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 12:27:39.976423 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:40.003575 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c22780-8774-48c8-98e4-032545d28e78 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:40.042916 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b92ae-3fc4-4509-ae6d-8652ceac8ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:40.043620 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b92ae-3fc4-4509-ae6d-8652ceac8ba8 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:40.043997 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b92ae-3fc4-4509-ae6d-8652ceac8ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:40.044371 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b92ae-3fc4-4509-ae6d-8652ceac8ba8 None admin] PATH_INFO: `/v3/domains` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:40.045178 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b92ae-3fc4-4509-ae6d-8652ceac8ba8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:40.045621 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b92ae-3fc4-4509-ae6d-8652ceac8ba8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:40.047111 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b92ae-3fc4-4509-ae6d-8652ceac8ba8 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:40.061588 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 238/474] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:40.067240 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7dcbd7-3807-4af7-8f3d-3c9428a17c84 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:40.083700 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:40.189571 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7dcbd7-3807-4af7-8f3d-3c9428a17c84 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:40.224948 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2fd824-be64-4c06-ae04-2a6ecfc5459f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:40.225572 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fd824-be64-4c06-ae04-2a6ecfc5459f None admin] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:40.225885 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fd824-be64-4c06-ae04-2a6ecfc5459f None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:40.226164 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fd824-be64-4c06-ae04-2a6ecfc5459f None admin] PATH_INFO: `/v3/users` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:40.226892 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2fd824-be64-4c06-ae04-2a6ecfc5459f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:40.228388 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2fd824-be64-4c06-ae04-2a6ecfc5459f None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:40.251501 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 237/475] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jul 27 12:27:40 2022] POST /identity/v3/users => generated 249 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 12:27:41.673001 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ca30f-c070-4447-84b3-88709185093c None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:41.673542 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ca30f-c070-4447-84b3-88709185093c None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:41.673542 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ca30f-c070-4447-84b3-88709185093c None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:41.675174 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 239/476] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:41.683040 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b802d-5d37-4606-8930-48d42bc2ce02 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:41.683491 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b802d-5d37-4606-8930-48d42bc2ce02 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:41.683704 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b802d-5d37-4606-8930-48d42bc2ce02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:41.707398 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-680b802d-5d37-4606-8930-48d42bc2ce02 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:41.708961 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-680b802d-5d37-4606-8930-48d42bc2ce02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:41.771465 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:41.782754 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 238/477] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:27:41.807140 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ca30f-c070-4447-84b3-88709185093c None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:41.875333 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ec7aa-0a76-49fd-9cf0-e8a4d207e846 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:41.875699 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ec7aa-0a76-49fd-9cf0-e8a4d207e846 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:41.876719 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ec7aa-0a76-49fd-9cf0-e8a4d207e846 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:41.877945 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 239/478] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:41.885953 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6fd1f-9948-4a0e-b944-cc9ea77d4543 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:41.886498 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6fd1f-9948-4a0e-b944-cc9ea77d4543 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:41.886975 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6fd1f-9948-4a0e-b944-cc9ea77d4543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:41.905610 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-06d6fd1f-9948-4a0e-b944-cc9ea77d4543 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:41.907690 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-06d6fd1f-9948-4a0e-b944-cc9ea77d4543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:41.920085 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ca30f-c070-4447-84b3-88709185093c None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:41.962513 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac1286-d623-4989-86b7-29c0ff210b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:41.964077 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac1286-d623-4989-86b7-29c0ff210b7b None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:41.964591 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac1286-d623-4989-86b7-29c0ff210b7b None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:41.965077 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac1286-d623-4989-86b7-29c0ff210b7b None admin] PATH_INFO: `/v3/roles/service` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:41.974319 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:41.979502 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac1286-d623-4989-86b7-29c0ff210b7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:41.987473 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-c3ac1286-d623-4989-86b7-29c0ff210b7b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 12:27:41.987473 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:41.987473 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:41.987473 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:41.987473 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:41.987473 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:41.987473 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:41.987473 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:41.987473 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:41.987473 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:41.987473 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:41.987473 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:41.987473 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:41.987473 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:41.987473 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:41.987473 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:41.988357 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:41.988357 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:41.988357 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:41.988357 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:41.988357 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:41.988357 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:41.988357 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:41.988357 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:41.988357 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:41.988357 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:41.988357 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:41.988357 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:41.988357 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:41.988357 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:41.988357 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:41.988357 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:41.989144 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:41.989144 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:41.989144 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:41.989144 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:41.989144 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:41.989144 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:41.989144 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:41.989144 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:41.989144 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:41.989144 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:41.989144 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 12:27:41.989144 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:41.989144 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 240/479] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jul 27 12:27:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:41.995348 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac1286-d623-4989-86b7-29c0ff210b7b None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:41.997769 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 240/480] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 12:27:42.022446 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6fd1f-9948-4a0e-b944-cc9ea77d4543 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:42.103938 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac1286-d623-4989-86b7-29c0ff210b7b None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:42.128922 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6fd1f-9948-4a0e-b944-cc9ea77d4543 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:42.141990 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829806fe-fe26-43ce-adf8-4576210f393c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:42.142529 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829806fe-fe26-43ce-adf8-4576210f393c None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:42.142813 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829806fe-fe26-43ce-adf8-4576210f393c None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:42.143091 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829806fe-fe26-43ce-adf8-4576210f393c None admin] PATH_INFO: `/v3/roles` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:42.143834 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829806fe-fe26-43ce-adf8-4576210f393c None admin] RBAC: Adding query filter params (name=service) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:42.144130 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829806fe-fe26-43ce-adf8-4576210f393c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:42.145554 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829806fe-fe26-43ce-adf8-4576210f393c None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:42.161101 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:42.161294 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 241/481] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jul 27 12:27:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:27:42.163156 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829806fe-fe26-43ce-adf8-4576210f393c None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:42.176680 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef769494-72be-42dc-a900-1a63d986ecb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:42.177741 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef769494-72be-42dc-a900-1a63d986ecb7 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:42.178227 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef769494-72be-42dc-a900-1a63d986ecb7 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:42.178703 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef769494-72be-42dc-a900-1a63d986ecb7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:42.191087 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef769494-72be-42dc-a900-1a63d986ecb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:42.198822 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-ef769494-72be-42dc-a900-1a63d986ecb7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 12:27:42.198822 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:42.198822 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:42.198822 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:42.198822 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:42.198822 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:42.198822 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:42.198822 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:42.198822 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:42.198822 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:42.198822 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:42.198822 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:42.198822 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:42.198822 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:42.198822 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:42.198822 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:42.199681 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:42.199681 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:42.199681 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:42.199681 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:42.199681 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:42.199681 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:42.199681 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:42.199681 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:42.199681 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:42.199681 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:42.199681 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:42.199681 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:42.199681 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:42.199681 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:42.199681 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:42.199681 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:42.200479 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:42.200479 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:42.200479 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:42.200479 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:42.200479 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:42.200479 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:42.200479 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:42.200479 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:42.200479 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:42.200479 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:42.200479 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 12:27:42.200479 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:42.208269 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 241/482] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jul 27 12:27:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 12:27:42.209651 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef769494-72be-42dc-a900-1a63d986ecb7 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:42.235988 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:42.285325 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829806fe-fe26-43ce-adf8-4576210f393c None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:42.321250 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38ae58-f57d-4597-856a-7975cba05fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:42.321899 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38ae58-f57d-4597-856a-7975cba05fbe None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:42.322181 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38ae58-f57d-4597-856a-7975cba05fbe None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:42.322455 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38ae58-f57d-4597-856a-7975cba05fbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:42.330891 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef769494-72be-42dc-a900-1a63d986ecb7 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:42.333633 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38ae58-f57d-4597-856a-7975cba05fbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:42.334694 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38ae58-f57d-4597-856a-7975cba05fbe None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:42.350081 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-ea38ae58-f57d-4597-856a-7975cba05fbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:42.350081 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:42.350081 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:42.350081 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:42.350081 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:42.350081 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:42.350081 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:42.350081 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:42.350081 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:42.350081 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:42.350081 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:42.350081 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:42.350081 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:27:42.350081 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:27:42.350081 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:27:42.350985 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:27:42.350985 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:42.350985 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:42.350985 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:42.350985 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:42.350985 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:42.350985 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:42.350985 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:42.350985 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:42.350985 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:42.350985 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:42.350985 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:42.350985 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:42.350985 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:42.350985 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:42.350985 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:42.350985 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:42.352409 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:27:42.352409 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:27:42.352409 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:42.352409 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:42.352409 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 242/483] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:27:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:42.352720 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e5abc-d987-4aea-9788-d997042a53ce None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:42.352975 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e5abc-d987-4aea-9788-d997042a53ce None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:42.353246 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e5abc-d987-4aea-9788-d997042a53ce None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:42.354668 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 243/484] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:42.358448 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e5abc-d987-4aea-9788-d997042a53ce None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:42.372846 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df079f-f562-4ad8-b9e7-a3d2d9705870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:42.373645 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df079f-f562-4ad8-b9e7-a3d2d9705870 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:42.373946 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df079f-f562-4ad8-b9e7-a3d2d9705870 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:42.374229 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df079f-f562-4ad8-b9e7-a3d2d9705870 None admin] PATH_INFO: `/v3/roles` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:42.375001 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df079f-f562-4ad8-b9e7-a3d2d9705870 None admin] RBAC: Adding query filter params (name=service) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:42.375310 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df079f-f562-4ad8-b9e7-a3d2d9705870 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:42.376787 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df079f-f562-4ad8-b9e7-a3d2d9705870 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:42.386438 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 242/485] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jul 27 12:27:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:42.392909 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f81fe6-fb71-4363-a5d0-f2e652e94964 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:42.393205 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f81fe6-fb71-4363-a5d0-f2e652e94964 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:42.393470 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f81fe6-fb71-4363-a5d0-f2e652e94964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:42.413068 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-27f81fe6-fb71-4363-a5d0-f2e652e94964 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:42.414308 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-27f81fe6-fb71-4363-a5d0-f2e652e94964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:42.457759 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:42.473106 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e5abc-d987-4aea-9788-d997042a53ce None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:42.497698 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:42.497867 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 243/486] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:27:42.497867 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f81fe6-fb71-4363-a5d0-f2e652e94964 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:42.521824 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30443f6c-6265-4c13-9b57-4d3a07673dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:42.522908 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30443f6c-6265-4c13-9b57-4d3a07673dbf None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:42.523525 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30443f6c-6265-4c13-9b57-4d3a07673dbf None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:42.523810 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30443f6c-6265-4c13-9b57-4d3a07673dbf None admin] PATH_INFO: `/v3/domains` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:42.524671 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30443f6c-6265-4c13-9b57-4d3a07673dbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:42.524999 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30443f6c-6265-4c13-9b57-4d3a07673dbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:42.527033 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30443f6c-6265-4c13-9b57-4d3a07673dbf None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:42.541566 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 244/487] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:27:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:42.542446 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30443f6c-6265-4c13-9b57-4d3a07673dbf None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:42.602206 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f81fe6-fb71-4363-a5d0-f2e652e94964 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:42.636955 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359e8f7-1282-43f3-a880-11e1d6f14a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:42.637611 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359e8f7-1282-43f3-a880-11e1d6f14a28 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:42.637901 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359e8f7-1282-43f3-a880-11e1d6f14a28 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:42.638269 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359e8f7-1282-43f3-a880-11e1d6f14a28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:42.642927 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30443f6c-6265-4c13-9b57-4d3a07673dbf None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:42.648000 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359e8f7-1282-43f3-a880-11e1d6f14a28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:42.649458 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359e8f7-1282-43f3-a880-11e1d6f14a28 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:42.664602 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-e359e8f7-1282-43f3-a880-11e1d6f14a28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:42.664602 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:42.664602 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:42.664602 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:42.664602 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:42.664602 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:42.664602 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:42.664602 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:42.664602 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:42.664602 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:42.664602 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:42.664602 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:42.664602 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:27:42.664602 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:27:42.664602 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:27:42.665549 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:27:42.665549 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:42.665549 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:42.665549 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:42.665549 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:42.665549 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:42.665549 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:42.665549 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:42.665549 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:42.665549 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:42.665549 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:42.665549 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:42.665549 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:42.665549 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:42.665549 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:42.665549 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:42.665549 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:42.666526 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:27:42.666526 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:27:42.666526 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:42.666526 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:42.666526 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 244/488] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:27:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:42.666526 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ce161-8bfb-4a5b-8570-f7ebb7efeae0 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:42.673846 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ce161-8bfb-4a5b-8570-f7ebb7efeae0 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:42.673846 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ce161-8bfb-4a5b-8570-f7ebb7efeae0 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:42.673846 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 245/489] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:42.673846 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ce161-8bfb-4a5b-8570-f7ebb7efeae0 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:42.686479 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861da8b-b965-4ea9-8639-1c5391749a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:42.687152 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861da8b-b965-4ea9-8639-1c5391749a8c None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:42.687436 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861da8b-b965-4ea9-8639-1c5391749a8c None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:42.687714 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861da8b-b965-4ea9-8639-1c5391749a8c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:42.698931 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a861da8b-b965-4ea9-8639-1c5391749a8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:42.701079 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:42.704333 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-a861da8b-b965-4ea9-8639-1c5391749a8c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 12:27:42.704333 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:42.704333 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:42.704333 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:42.704333 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:42.704333 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:42.704333 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:42.704333 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:42.704333 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:42.704333 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:42.704333 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:42.704333 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:42.704333 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:42.704333 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:42.704333 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:42.704333 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:42.705206 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:42.705206 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:42.705206 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:42.705206 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:42.705206 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:42.705206 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:42.705206 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:42.705206 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:42.705206 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:42.705206 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:42.705206 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:42.705206 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:42.705206 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:42.705206 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:42.705206 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:42.705206 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:42.706070 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:42.706070 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:42.706070 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:42.706070 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:42.706070 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:42.706070 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:42.706070 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:42.706070 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:42.706070 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:42.706070 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:42.706070 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 12:27:42.706070 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:42.706070 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 245/490] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jul 27 12:27:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:42.706717 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861da8b-b965-4ea9-8639-1c5391749a8c None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:42.737785 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:42.781546 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ce161-8bfb-4a5b-8570-f7ebb7efeae0 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:42.805587 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861da8b-b965-4ea9-8639-1c5391749a8c None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:42.821524 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5140c6-b289-4d49-a7b2-5efb2f6e8ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:42.822192 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5140c6-b289-4d49-a7b2-5efb2f6e8ffa None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:42.822556 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5140c6-b289-4d49-a7b2-5efb2f6e8ffa None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:42.822853 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5140c6-b289-4d49-a7b2-5efb2f6e8ffa None admin] PATH_INFO: `/v3/users/nova` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:42.830460 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5140c6-b289-4d49-a7b2-5efb2f6e8ffa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:42.831925 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5140c6-b289-4d49-a7b2-5efb2f6e8ffa None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:42.839137 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8242f-144b-43ff-93d0-11f01def4b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:42.839761 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8242f-144b-43ff-93d0-11f01def4b72 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:42.840045 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8242f-144b-43ff-93d0-11f01def4b72 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:42.840323 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8242f-144b-43ff-93d0-11f01def4b72 None admin] PATH_INFO: `/v3/domains` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:42.841027 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab8242f-144b-43ff-93d0-11f01def4b72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:42.841334 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab8242f-144b-43ff-93d0-11f01def4b72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:42.842814 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab8242f-144b-43ff-93d0-11f01def4b72 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:42.847112 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-fd5140c6-b289-4d49-a7b2-5efb2f6e8ffa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 12:27:42.847112 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:42.847112 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:42.847112 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:42.847112 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:42.847112 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:42.847112 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:42.847112 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:42.847112 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:42.847112 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:42.847112 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:42.847112 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:42.847112 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 12:27:42.847112 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 12:27:42.847112 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 12:27:42.847112 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 12:27:42.848737 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:42.848737 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:42.848737 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 12:27:42.848737 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:27:42.848737 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 12:27:42.848737 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:27:42.848737 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:42.848737 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:42.848737 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:42.848737 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:42.848737 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:42.848737 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:42.848737 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:42.848737 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:42.848737 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:42.848737 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:42.848737 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:42.848737 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:42.850307 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:42.850307 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:42.850307 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 12:27:42.850307 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 12:27:42.850307 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 12:27:42.850307 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 12:27:42.850307 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 12:27:42.850307 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 12:27:42.850307 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 12:27:42.850307 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:42.850307 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 246/491] 10.222.0.55 () {56 vars in 1093 bytes} [Wed Jul 27 12:27:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:42.850307 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a0b32-0106-4be4-9beb-e40acebde4d2 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:42.850307 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a0b32-0106-4be4-9beb-e40acebde4d2 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:42.851068 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a0b32-0106-4be4-9beb-e40acebde4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:42.866682 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 246/492] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:27:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:42.867599 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8242f-144b-43ff-93d0-11f01def4b72 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:42.869467 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-ea3a0b32-0106-4be4-9beb-e40acebde4d2 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:42.870681 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-ea3a0b32-0106-4be4-9beb-e40acebde4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:42.938610 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 247/493] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:27:42.939451 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a0b32-0106-4be4-9beb-e40acebde4d2 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:42.959816 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:42.965954 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:42.975519 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8242f-144b-43ff-93d0-11f01def4b72 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:43.009114 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9d19d-512b-4b5f-b875-552f620e7ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:43.009758 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9d19d-512b-4b5f-b875-552f620e7ee7 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:43.010191 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9d19d-512b-4b5f-b875-552f620e7ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:43.010459 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9d19d-512b-4b5f-b875-552f620e7ee7 None admin] PATH_INFO: `/v3/roles` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:43.011173 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9d19d-512b-4b5f-b875-552f620e7ee7 None admin] RBAC: Adding query filter params (name=service) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:43.011473 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9d19d-512b-4b5f-b875-552f620e7ee7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:43.012831 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9d19d-512b-4b5f-b875-552f620e7ee7 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:43.020903 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 247/494] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jul 27 12:27:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:43.021709 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9d19d-512b-4b5f-b875-552f620e7ee7 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:43.044508 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a0b32-0106-4be4-9beb-e40acebde4d2 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:43.078030 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1ed5c-f012-4fe7-8e26-97decec358f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:43.078640 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1ed5c-f012-4fe7-8e26-97decec358f2 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:43.078948 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1ed5c-f012-4fe7-8e26-97decec358f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:43.079220 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1ed5c-f012-4fe7-8e26-97decec358f2 None admin] PATH_INFO: `/v3/users` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:43.080001 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d1ed5c-f012-4fe7-8e26-97decec358f2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:43.080302 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d1ed5c-f012-4fe7-8e26-97decec358f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:43.081787 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d1ed5c-f012-4fe7-8e26-97decec358f2 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:43.117964 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 248/495] 10.222.0.55 () {56 vars in 1133 bytes} [Wed Jul 27 12:27:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:43.118778 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1ed5c-f012-4fe7-8e26-97decec358f2 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:43.119625 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9d19d-512b-4b5f-b875-552f620e7ee7 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:43.154646 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc6a03-f0a9-4f1d-b2e3-2e449e51a82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:43.155282 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc6a03-f0a9-4f1d-b2e3-2e449e51a82b None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:43.155565 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc6a03-f0a9-4f1d-b2e3-2e449e51a82b None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:43.155840 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc6a03-f0a9-4f1d-b2e3-2e449e51a82b None admin] PATH_INFO: `/v3/users/glance` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:43.163750 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc6a03-f0a9-4f1d-b2e3-2e449e51a82b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:43.165169 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc6a03-f0a9-4f1d-b2e3-2e449e51a82b None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:43.178083 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-adbc6a03-f0a9-4f1d-b2e3-2e449e51a82b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 12:27:43.178083 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:43.178083 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:43.178083 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:43.178083 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:43.178083 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:43.178083 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:43.178083 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:43.178083 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:43.178083 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:43.178083 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:43.178083 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:43.178083 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 12:27:43.178083 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 12:27:43.178083 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 12:27:43.178083 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 12:27:43.179169 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:43.179169 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:43.179169 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 12:27:43.179169 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:27:43.179169 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 12:27:43.179169 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:27:43.179169 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:43.179169 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:43.179169 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:43.179169 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:43.179169 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:43.179169 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:43.179169 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:43.179169 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:43.179169 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:43.179169 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:43.179169 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:43.179169 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:43.180071 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:43.180071 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:43.180071 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 12:27:43.180071 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 12:27:43.180071 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 12:27:43.180071 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 12:27:43.180071 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 12:27:43.180071 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 12:27:43.180071 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 12:27:43.180071 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:43.180071 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 248/496] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:27:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:43.180071 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc6a03-f0a9-4f1d-b2e3-2e449e51a82b None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:43.196820 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:43.205713 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:43.231914 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1ed5c-f012-4fe7-8e26-97decec358f2 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:43.265888 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e9cbb-e35a-4991-b76e-bbfa5d46dcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:43.267056 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e9cbb-e35a-4991-b76e-bbfa5d46dcd6 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:43.267372 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e9cbb-e35a-4991-b76e-bbfa5d46dcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:43.267652 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e9cbb-e35a-4991-b76e-bbfa5d46dcd6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:43.277848 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e9cbb-e35a-4991-b76e-bbfa5d46dcd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:43.283400 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-cb5e9cbb-e35a-4991-b76e-bbfa5d46dcd6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 12:27:43.283400 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:43.283400 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:43.283400 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:43.283400 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:43.283400 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:43.283400 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:43.283400 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:43.283400 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:43.283400 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:43.283400 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:43.283400 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:43.283400 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:43.283400 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:43.283400 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:43.283400 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:43.284464 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:43.284464 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:43.284464 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:43.284464 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:43.284464 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:43.284464 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:43.284464 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:43.284464 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:43.284464 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:43.284464 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:43.284464 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:43.284464 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:43.284464 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:43.284464 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:43.284464 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:43.284464 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:43.285450 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:43.285450 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:43.285450 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:43.285450 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:43.285450 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:43.285450 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:43.285450 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:43.285450 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:43.285450 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:43.285450 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:43.285450 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 12:27:43.285450 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:43.285450 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 249/497] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jul 27 12:27:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:43.286335 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e9cbb-e35a-4991-b76e-bbfa5d46dcd6 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:43.292958 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc6a03-f0a9-4f1d-b2e3-2e449e51a82b None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:43.325240 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180dd2aa-699f-457d-9e40-673d60d3c993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:43.325847 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180dd2aa-699f-457d-9e40-673d60d3c993 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:43.326131 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180dd2aa-699f-457d-9e40-673d60d3c993 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:43.326406 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180dd2aa-699f-457d-9e40-673d60d3c993 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:43.337152 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180dd2aa-699f-457d-9e40-673d60d3c993 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:43.338645 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180dd2aa-699f-457d-9e40-673d60d3c993 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:43.353127 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-180dd2aa-699f-457d-9e40-673d60d3c993 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:43.353127 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:43.353127 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:43.353127 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:43.353127 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:43.353127 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:43.353127 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:43.353127 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:43.353127 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:43.353127 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:43.353127 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:43.353127 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:43.353127 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:27:43.353127 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:27:43.353127 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:27:43.354202 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:27:43.354202 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:43.354202 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:43.354202 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:43.354202 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:43.354202 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:43.354202 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:43.354202 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:43.354202 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:43.354202 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:43.354202 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:43.354202 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:43.354202 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:43.354202 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:43.354202 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:43.354202 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:43.354202 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:43.355083 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:27:43.355083 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:27:43.355083 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:43.355083 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:43.355083 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 249/498] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:27:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:43.355355 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180dd2aa-699f-457d-9e40-673d60d3c993 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:43.383610 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e9cbb-e35a-4991-b76e-bbfa5d46dcd6 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:43.417507 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7e7cb-830e-479c-8f3c-cc0e24a55b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:43.418148 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7e7cb-830e-479c-8f3c-cc0e24a55b4a None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:43.418435 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7e7cb-830e-479c-8f3c-cc0e24a55b4a None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:43.418711 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7e7cb-830e-479c-8f3c-cc0e24a55b4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:43.419508 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:43.422518 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:43.455481 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180dd2aa-699f-457d-9e40-673d60d3c993 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:43.485560 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7e7cb-830e-479c-8f3c-cc0e24a55b4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:43.487124 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7e7cb-830e-479c-8f3c-cc0e24a55b4a None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:43.487878 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a571d9-739d-4080-adb7-9c6e2d8bb23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:43.488482 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a571d9-739d-4080-adb7-9c6e2d8bb23a None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:43.488763 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a571d9-739d-4080-adb7-9c6e2d8bb23a None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:43.489032 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a571d9-739d-4080-adb7-9c6e2d8bb23a None admin] PATH_INFO: `/v3/users` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:43.489837 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a571d9-739d-4080-adb7-9c6e2d8bb23a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:43.490138 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a571d9-739d-4080-adb7-9c6e2d8bb23a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:43.491802 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a571d9-739d-4080-adb7-9c6e2d8bb23a None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:43.528275 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 250/499] 10.222.0.55 () {56 vars in 1137 bytes} [Wed Jul 27 12:27:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:43.529125 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a571d9-739d-4080-adb7-9c6e2d8bb23a None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:43.593268 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 250/500] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jul 27 12:27:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 12:27:43.593932 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7e7cb-830e-479c-8f3c-cc0e24a55b4a None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:43.630939 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:43.640213 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a571d9-739d-4080-adb7-9c6e2d8bb23a None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:43.663894 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:43.678068 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67abb7b-aa06-460d-ab96-851a44c706b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:43.678690 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67abb7b-aa06-460d-ab96-851a44c706b6 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:43.678967 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67abb7b-aa06-460d-ab96-851a44c706b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:43.679237 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67abb7b-aa06-460d-ab96-851a44c706b6 None admin] PATH_INFO: `/v3/roles` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:43.679978 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67abb7b-aa06-460d-ab96-851a44c706b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:43.680259 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67abb7b-aa06-460d-ab96-851a44c706b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:43.681632 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67abb7b-aa06-460d-ab96-851a44c706b6 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:43.691354 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 251/501] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jul 27 12:27:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:43.692160 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67abb7b-aa06-460d-ab96-851a44c706b6 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:43.701817 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7e7cb-830e-479c-8f3c-cc0e24a55b4a None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:43.736994 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e6e101-0763-4164-b342-77b609f1bce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:43.737616 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6e101-0763-4164-b342-77b609f1bce8 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:43.737918 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6e101-0763-4164-b342-77b609f1bce8 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:43.738191 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6e101-0763-4164-b342-77b609f1bce8 None admin] PATH_INFO: `/v3/domains` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:43.738871 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e6e101-0763-4164-b342-77b609f1bce8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:43.739170 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e6e101-0763-4164-b342-77b609f1bce8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:43.740541 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e6e101-0763-4164-b342-77b609f1bce8 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:43.751887 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 251/502] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:43.752659 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e6e101-0763-4164-b342-77b609f1bce8 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:43.796215 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67abb7b-aa06-460d-ab96-851a44c706b6 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:43.829328 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe14fd3-e724-46c9-82ac-f51c368eca25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:43.829971 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe14fd3-e724-46c9-82ac-f51c368eca25 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:43.830246 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe14fd3-e724-46c9-82ac-f51c368eca25 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:43.830512 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe14fd3-e724-46c9-82ac-f51c368eca25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:43.846397 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:43.852483 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e6e101-0763-4164-b342-77b609f1bce8 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:43.886570 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:43.886947 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094b095-832f-4a57-bcbf-6299d1ab8956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:43.887699 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094b095-832f-4a57-bcbf-6299d1ab8956 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:43.888109 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094b095-832f-4a57-bcbf-6299d1ab8956 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:43.888518 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094b095-832f-4a57-bcbf-6299d1ab8956 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:43.899979 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4094b095-832f-4a57-bcbf-6299d1ab8956 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:43.900853 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe14fd3-e724-46c9-82ac-f51c368eca25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:43.901475 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4094b095-832f-4a57-bcbf-6299d1ab8956 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:43.902328 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe14fd3-e724-46c9-82ac-f51c368eca25 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:43.915377 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-4094b095-832f-4a57-bcbf-6299d1ab8956 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:43.915377 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:43.915377 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:43.915377 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:43.915377 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:43.915377 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:43.915377 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:43.915377 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:43.915377 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:43.915377 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:43.915377 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:43.915377 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:43.915377 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:27:43.915377 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:27:43.915377 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:27:43.916221 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:27:43.916221 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:43.916221 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:43.916221 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:43.916221 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:43.916221 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:43.916221 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:43.916221 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:43.916221 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:43.916221 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:43.916221 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:43.916221 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:43.916221 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:43.916221 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:43.916221 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:43.916221 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:43.916221 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:43.917076 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:27:43.917076 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:27:43.917076 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:43.917076 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:43.917076 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 252/503] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:27:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:43.917343 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094b095-832f-4a57-bcbf-6299d1ab8956 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:44.000106 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 252/504] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jul 27 12:27:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 12:27:44.001582 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe14fd3-e724-46c9-82ac-f51c368eca25 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:44.022245 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094b095-832f-4a57-bcbf-6299d1ab8956 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:44.055346 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca402b-6ffb-4f6f-ab79-7769abb8fc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:44.055978 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca402b-6ffb-4f6f-ab79-7769abb8fc0f None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:44.056260 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca402b-6ffb-4f6f-ab79-7769abb8fc0f None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:44.056538 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca402b-6ffb-4f6f-ab79-7769abb8fc0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:44.067582 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca402b-6ffb-4f6f-ab79-7769abb8fc0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:44.069034 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca402b-6ffb-4f6f-ab79-7769abb8fc0f None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:44.077175 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:44.083578 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:44.084896 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-baca402b-6ffb-4f6f-ab79-7769abb8fc0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:44.084896 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:44.084896 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:44.084896 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:44.084896 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:44.084896 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:44.084896 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:44.084896 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:44.084896 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:44.084896 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:44.084896 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:44.084896 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:44.084896 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:27:44.084896 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:27:44.084896 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:27:44.085793 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:27:44.085793 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:44.085793 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:44.085793 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:44.085793 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:44.085793 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:44.085793 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:44.085793 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:44.085793 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:44.085793 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:44.085793 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:44.085793 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:44.085793 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:44.085793 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:44.085793 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:44.085793 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:44.085793 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:44.086677 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:27:44.086677 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:27:44.086677 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:44.086677 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:44.090893 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 253/505] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:27:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:44.091792 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca402b-6ffb-4f6f-ab79-7769abb8fc0f None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:44.100470 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe14fd3-e724-46c9-82ac-f51c368eca25 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:44.134841 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f78de-5427-44d8-84ad-75a2764b11c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:44.135469 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f78de-5427-44d8-84ad-75a2764b11c3 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:44.135747 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f78de-5427-44d8-84ad-75a2764b11c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:44.136017 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f78de-5427-44d8-84ad-75a2764b11c3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:44.142849 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893f78de-5427-44d8-84ad-75a2764b11c3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:44.144286 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893f78de-5427-44d8-84ad-75a2764b11c3 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:44.156747 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-893f78de-5427-44d8-84ad-75a2764b11c3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 12:27:44.156747 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:44.156747 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:44.156747 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:44.156747 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:44.156747 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:44.156747 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:44.156747 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:44.156747 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:44.156747 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:44.156747 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:44.156747 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:44.156747 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 12:27:44.156747 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 12:27:44.156747 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 12:27:44.156747 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 12:27:44.157753 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:44.157753 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:44.157753 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 12:27:44.157753 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:27:44.157753 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 12:27:44.157753 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:27:44.157753 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:44.157753 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:44.157753 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:44.157753 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:44.157753 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:44.157753 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:44.157753 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:44.157753 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:44.157753 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:44.157753 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:44.157753 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:44.157753 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:44.159026 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:44.159026 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:44.159026 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 12:27:44.159026 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 12:27:44.159026 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 12:27:44.159026 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 12:27:44.159026 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 12:27:44.159026 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 12:27:44.159026 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 12:27:44.159026 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:44.159026 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 253/506] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:27:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:44.159686 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f78de-5427-44d8-84ad-75a2764b11c3 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:44.194023 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca402b-6ffb-4f6f-ab79-7769abb8fc0f None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:44.226614 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08071289-43f9-4f12-bcee-e9a9b37fd1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:44.227228 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08071289-43f9-4f12-bcee-e9a9b37fd1e4 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:44.227514 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08071289-43f9-4f12-bcee-e9a9b37fd1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:44.227793 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08071289-43f9-4f12-bcee-e9a9b37fd1e4 None admin] PATH_INFO: `/v3/domains` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:44.228485 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08071289-43f9-4f12-bcee-e9a9b37fd1e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:44.228792 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08071289-43f9-4f12-bcee-e9a9b37fd1e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:44.230218 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08071289-43f9-4f12-bcee-e9a9b37fd1e4 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:44.242340 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 254/507] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:27:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:44.243121 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08071289-43f9-4f12-bcee-e9a9b37fd1e4 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:44.258259 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f78de-5427-44d8-84ad-75a2764b11c3 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:44.292185 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017fb34b-c34d-49e0-978e-9dfad10a820d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:44.292817 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fb34b-c34d-49e0-978e-9dfad10a820d None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:44.293098 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fb34b-c34d-49e0-978e-9dfad10a820d None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:44.293372 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fb34b-c34d-49e0-978e-9dfad10a820d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:44.303508 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:44.304987 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017fb34b-c34d-49e0-978e-9dfad10a820d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:44.306580 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017fb34b-c34d-49e0-978e-9dfad10a820d None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:44.312890 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:44.321885 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-017fb34b-c34d-49e0-978e-9dfad10a820d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:44.321885 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:44.321885 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:44.321885 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:44.321885 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:44.321885 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:44.321885 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:44.321885 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:44.321885 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:44.321885 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:44.321885 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:44.321885 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:44.321885 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:27:44.321885 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:27:44.321885 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:27:44.322727 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:27:44.322727 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:44.322727 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:44.322727 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:44.322727 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:44.322727 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:44.322727 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:44.322727 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:44.322727 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:44.322727 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:44.322727 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:44.322727 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:44.322727 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:44.322727 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:44.322727 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:44.322727 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:44.322727 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:44.323579 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:27:44.323579 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:27:44.323579 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:44.323579 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:44.323579 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 254/508] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:27:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:44.323899 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017fb34b-c34d-49e0-978e-9dfad10a820d None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:44.348010 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08071289-43f9-4f12-bcee-e9a9b37fd1e4 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:44.382083 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1055033-2c04-4696-8e0c-ddc69a49c091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:44.382630 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1055033-2c04-4696-8e0c-ddc69a49c091 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:44.382912 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1055033-2c04-4696-8e0c-ddc69a49c091 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:44.383189 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1055033-2c04-4696-8e0c-ddc69a49c091 None admin] PATH_INFO: `/v3/domains` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:44.383881 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1055033-2c04-4696-8e0c-ddc69a49c091 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:44.384190 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1055033-2c04-4696-8e0c-ddc69a49c091 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:44.385563 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1055033-2c04-4696-8e0c-ddc69a49c091 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:44.396508 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 255/509] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:27:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:44.397409 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1055033-2c04-4696-8e0c-ddc69a49c091 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:44.421847 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017fb34b-c34d-49e0-978e-9dfad10a820d None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:44.455464 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9bae5c-fe9a-4955-90fc-c178ad95cfcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:44.456070 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bae5c-fe9a-4955-90fc-c178ad95cfcb None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:44.456349 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bae5c-fe9a-4955-90fc-c178ad95cfcb None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:44.456868 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bae5c-fe9a-4955-90fc-c178ad95cfcb None admin] PATH_INFO: `/v3/users` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:44.457417 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9bae5c-fe9a-4955-90fc-c178ad95cfcb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:44.457761 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9bae5c-fe9a-4955-90fc-c178ad95cfcb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:44.459168 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9bae5c-fe9a-4955-90fc-c178ad95cfcb None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:44.477437 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 255/510] 10.222.0.55 () {56 vars in 1137 bytes} [Wed Jul 27 12:27:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:44.478211 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9bae5c-fe9a-4955-90fc-c178ad95cfcb None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:44.494373 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1055033-2c04-4696-8e0c-ddc69a49c091 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:44.514164 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:44.529532 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8a768-baf2-4440-b85d-20f724ef0b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:44.530271 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8a768-baf2-4440-b85d-20f724ef0b81 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:44.530572 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8a768-baf2-4440-b85d-20f724ef0b81 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:44.530873 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8a768-baf2-4440-b85d-20f724ef0b81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:44.534065 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:44.538099 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8a768-baf2-4440-b85d-20f724ef0b81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:44.539550 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8a768-baf2-4440-b85d-20f724ef0b81 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:44.552759 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-ebd8a768-baf2-4440-b85d-20f724ef0b81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 12:27:44.552759 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:44.552759 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:44.552759 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:44.552759 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:44.552759 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:44.552759 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:44.552759 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:44.552759 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:44.552759 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:44.552759 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:44.552759 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:44.552759 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 12:27:44.552759 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 12:27:44.552759 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 12:27:44.553810 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 12:27:44.553810 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:44.553810 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:44.553810 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:44.553810 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:44.553810 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:44.553810 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:44.553810 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:44.553810 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:44.553810 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:44.553810 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:44.553810 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:44.553810 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:44.553810 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:44.553810 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:44.553810 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:44.553810 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:44.554887 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 12:27:44.554887 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 12:27:44.554887 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 12:27:44.554887 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 12:27:44.554887 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 12:27:44.554887 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 12:27:44.554887 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 12:27:44.554887 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:44.554887 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 256/511] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jul 27 12:27:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:44.554887 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8a768-baf2-4440-b85d-20f724ef0b81 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:44.581668 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9bae5c-fe9a-4955-90fc-c178ad95cfcb None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:44.616185 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d71fcc-99d2-4fdc-864c-51039ccbb031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:44.616806 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d71fcc-99d2-4fdc-864c-51039ccbb031 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:44.617102 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d71fcc-99d2-4fdc-864c-51039ccbb031 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:44.617398 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d71fcc-99d2-4fdc-864c-51039ccbb031 None admin] PATH_INFO: `/v3/domains` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:44.618126 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d71fcc-99d2-4fdc-864c-51039ccbb031 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:44.618742 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d71fcc-99d2-4fdc-864c-51039ccbb031 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:44.619811 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d71fcc-99d2-4fdc-864c-51039ccbb031 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:44.631987 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 256/512] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:27:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:44.632827 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d71fcc-99d2-4fdc-864c-51039ccbb031 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:44.662266 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8a768-baf2-4440-b85d-20f724ef0b81 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:44.700675 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d69996-6596-410a-b726-c293771e778b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:44.701321 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d69996-6596-410a-b726-c293771e778b None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:44.701629 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d69996-6596-410a-b726-c293771e778b None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:44.701917 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d69996-6596-410a-b726-c293771e778b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:44.709487 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d69996-6596-410a-b726-c293771e778b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:44.710977 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d69996-6596-410a-b726-c293771e778b None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:44.722044 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-b7d69996-6596-410a-b726-c293771e778b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 12:27:44.722044 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:44.722044 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:44.722044 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:44.722044 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:44.722044 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:44.722044 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:44.722044 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:44.722044 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:44.722044 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:44.722044 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:44.722044 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:44.722044 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 12:27:44.722044 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 12:27:44.722044 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 12:27:44.722044 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 12:27:44.722954 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:44.722954 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:44.722954 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 12:27:44.722954 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:27:44.722954 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 12:27:44.722954 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:27:44.722954 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:44.722954 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:44.722954 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:44.722954 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:44.722954 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:44.722954 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:44.722954 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:44.722954 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:44.722954 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:44.722954 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:44.722954 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:44.722954 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:44.723833 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:44.723833 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:44.723833 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 12:27:44.723833 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 12:27:44.723833 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 12:27:44.723833 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 12:27:44.723833 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 12:27:44.723833 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 12:27:44.723833 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 12:27:44.723833 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:44.723833 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 257/513] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jul 27 12:27:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:44.724387 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d69996-6596-410a-b726-c293771e778b None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:44.745758 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d71fcc-99d2-4fdc-864c-51039ccbb031 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:44.762426 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:44.768578 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:44.780658 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b20811-ad7d-4356-a80a-1eeda8b2b696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:44.781327 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b20811-ad7d-4356-a80a-1eeda8b2b696 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:44.781639 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b20811-ad7d-4356-a80a-1eeda8b2b696 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:44.781922 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b20811-ad7d-4356-a80a-1eeda8b2b696 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:44.824977 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d69996-6596-410a-b726-c293771e778b None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:44.849579 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b20811-ad7d-4356-a80a-1eeda8b2b696 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:44.851056 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b20811-ad7d-4356-a80a-1eeda8b2b696 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:44.856827 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e75446-d624-4003-ab7e-a2fb577b42b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:44.857443 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e75446-d624-4003-ab7e-a2fb577b42b7 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:44.857752 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e75446-d624-4003-ab7e-a2fb577b42b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:44.858032 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e75446-d624-4003-ab7e-a2fb577b42b7 None admin] PATH_INFO: `/v3/projects` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:44.858783 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e75446-d624-4003-ab7e-a2fb577b42b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:44.859101 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e75446-d624-4003-ab7e-a2fb577b42b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:44.861343 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e75446-d624-4003-ab7e-a2fb577b42b7 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:44.881849 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 258/514] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jul 27 12:27:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:44.882771 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e75446-d624-4003-ab7e-a2fb577b42b7 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:44.951247 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 257/515] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jul 27 12:27:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 12:27:44.952101 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b20811-ad7d-4356-a80a-1eeda8b2b696 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:44.968579 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:44.983078 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:44.986578 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e75446-d624-4003-ab7e-a2fb577b42b7 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:45.020405 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ac0a2-3a7d-4077-bb02-0af7b96cff34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:45.021048 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ac0a2-3a7d-4077-bb02-0af7b96cff34 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:45.021330 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ac0a2-3a7d-4077-bb02-0af7b96cff34 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:45.021638 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ac0a2-3a7d-4077-bb02-0af7b96cff34 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:45.028101 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ac0a2-3a7d-4077-bb02-0af7b96cff34 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:45.029556 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ac0a2-3a7d-4077-bb02-0af7b96cff34 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:45.041285 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-452ac0a2-3a7d-4077-bb02-0af7b96cff34 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 12:27:45.041285 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:45.041285 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:45.041285 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:45.041285 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:45.041285 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:45.041285 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:45.041285 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:45.041285 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:45.041285 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:45.041285 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:45.041285 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:45.041285 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 12:27:45.041285 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 12:27:45.041285 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 12:27:45.042217 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 12:27:45.042217 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:45.042217 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:45.042217 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:45.042217 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:45.042217 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:45.042217 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:45.042217 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:45.042217 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:45.042217 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:45.042217 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:45.042217 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:45.042217 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:45.042217 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:45.042217 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:45.042217 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:45.042217 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:45.043057 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 12:27:45.043057 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 12:27:45.043057 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 12:27:45.043057 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 12:27:45.043057 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 12:27:45.043057 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 12:27:45.043057 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 12:27:45.043057 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:45.043057 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 259/516] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jul 27 12:27:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:45.043520 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ac0a2-3a7d-4077-bb02-0af7b96cff34 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:45.050919 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b20811-ad7d-4356-a80a-1eeda8b2b696 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:45.084982 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fec3da-1e42-4305-bfbf-ad4b62da8bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:45.085619 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fec3da-1e42-4305-bfbf-ad4b62da8bdd None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:45.085901 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fec3da-1e42-4305-bfbf-ad4b62da8bdd None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:45.086171 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fec3da-1e42-4305-bfbf-ad4b62da8bdd None admin] PATH_INFO: `/v3/users` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:45.086984 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fec3da-1e42-4305-bfbf-ad4b62da8bdd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:45.087291 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fec3da-1e42-4305-bfbf-ad4b62da8bdd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:45.088701 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fec3da-1e42-4305-bfbf-ad4b62da8bdd None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:45.105370 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 258/517] 10.222.0.55 () {56 vars in 1139 bytes} [Wed Jul 27 12:27:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:45.106196 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fec3da-1e42-4305-bfbf-ad4b62da8bdd None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:45.151231 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ac0a2-3a7d-4077-bb02-0af7b96cff34 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:45.178792 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:45.183740 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f4640-8831-4f8a-a426-56a25bb077cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:45.184355 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f4640-8831-4f8a-a426-56a25bb077cf None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:45.184638 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f4640-8831-4f8a-a426-56a25bb077cf None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:45.184915 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f4640-8831-4f8a-a426-56a25bb077cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:45.185728 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f4640-8831-4f8a-a426-56a25bb077cf None admin] RBAC: Adding query filter params (role.id=ec09bb8ea1664640a975563cc41cc39b, scope.project.id=e3316e9a169444ac827619608acc9fb7, user.id=36964c4644584d4282b04596ad20717c) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:45.186038 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f4640-8831-4f8a-a426-56a25bb077cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:45.187472 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f4640-8831-4f8a-a426-56a25bb077cf None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:45.193260 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 260/518] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jul 27 12:27:45 2022] GET /identity/v3/role_assignments?user.id=36964c4644584d4282b04596ad20717c&scope.project.id=e3316e9a169444ac827619608acc9fb7&role.id=ec09bb8ea1664640a975563cc41cc39b => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:45.194075 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f4640-8831-4f8a-a426-56a25bb077cf None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:45.208100 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fec3da-1e42-4305-bfbf-ad4b62da8bdd None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:45.222535 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:45.247166 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f3f60-dfeb-405e-b7b2-34053f2e2769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:45.247924 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f3f60-dfeb-405e-b7b2-34053f2e2769 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:45.248381 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f3f60-dfeb-405e-b7b2-34053f2e2769 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:45.248653 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f3f60-dfeb-405e-b7b2-34053f2e2769 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:45.261504 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f3f60-dfeb-405e-b7b2-34053f2e2769 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:45.263103 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f3f60-dfeb-405e-b7b2-34053f2e2769 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:45.280230 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-3e6f3f60-dfeb-405e-b7b2-34053f2e2769 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:45.280230 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:45.280230 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:45.280230 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:45.280230 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:45.280230 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:45.280230 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:45.280230 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:45.280230 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:45.280230 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:45.280230 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:45.280230 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:45.280230 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:27:45.280230 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:27:45.280230 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:27:45.281350 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:27:45.281350 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:45.281350 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:45.281350 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:45.281350 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:45.281350 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:45.281350 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:45.281350 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:45.281350 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:45.281350 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:45.281350 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:45.281350 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:45.281350 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:45.281350 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:45.281350 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:45.281350 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:45.281350 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:45.282518 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:27:45.282518 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:27:45.282518 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:45.282518 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:45.288102 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 259/519] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:27:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:45.288102 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f3f60-dfeb-405e-b7b2-34053f2e2769 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:45.313873 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f4640-8831-4f8a-a426-56a25bb077cf None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:45.356994 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af825e-0b21-48b1-bdcf-27fd03c641df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:45.357748 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af825e-0b21-48b1-bdcf-27fd03c641df None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:45.357935 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af825e-0b21-48b1-bdcf-27fd03c641df None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:45.358214 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af825e-0b21-48b1-bdcf-27fd03c641df None admin] PATH_INFO: `/v3/projects` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:45.359212 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af825e-0b21-48b1-bdcf-27fd03c641df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:45.359526 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af825e-0b21-48b1-bdcf-27fd03c641df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:45.360979 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af825e-0b21-48b1-bdcf-27fd03c641df None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:45.375452 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 261/520] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jul 27 12:27:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:45.376858 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af825e-0b21-48b1-bdcf-27fd03c641df None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:45.399011 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f3f60-dfeb-405e-b7b2-34053f2e2769 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:45.425892 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:45.434601 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ad725-8da4-4c12-8982-98d721acd920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:45.435216 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ad725-8da4-4c12-8982-98d721acd920 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:45.435496 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ad725-8da4-4c12-8982-98d721acd920 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:45.435769 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ad725-8da4-4c12-8982-98d721acd920 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:45.479124 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:45.497139 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af825e-0b21-48b1-bdcf-27fd03c641df None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:45.512291 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ad725-8da4-4c12-8982-98d721acd920 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:45.513870 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ad725-8da4-4c12-8982-98d721acd920 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:45.533811 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bae0f2-e044-44e6-8c8c-b87926b83c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:45.534449 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bae0f2-e044-44e6-8c8c-b87926b83c00 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:45.534739 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bae0f2-e044-44e6-8c8c-b87926b83c00 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:45.535037 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bae0f2-e044-44e6-8c8c-b87926b83c00 None admin] PATH_INFO: `/v3/domains` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:45.536229 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bae0f2-e044-44e6-8c8c-b87926b83c00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:45.536555 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bae0f2-e044-44e6-8c8c-b87926b83c00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:45.538329 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bae0f2-e044-44e6-8c8c-b87926b83c00 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:45.559583 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 262/521] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:45.559583 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bae0f2-e044-44e6-8c8c-b87926b83c00 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:45.620841 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 260/522] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jul 27 12:27:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 12:27:45.621871 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ad725-8da4-4c12-8982-98d721acd920 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:45.651620 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:45.678569 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bae0f2-e044-44e6-8c8c-b87926b83c00 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:45.726789 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b87791-ba0e-4013-8c07-86505fb4025a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:45.727484 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b87791-ba0e-4013-8c07-86505fb4025a None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:45.727789 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b87791-ba0e-4013-8c07-86505fb4025a None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:45.728092 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b87791-ba0e-4013-8c07-86505fb4025a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:45.728904 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b87791-ba0e-4013-8c07-86505fb4025a None admin] RBAC: Adding query filter params (role.id=ec09bb8ea1664640a975563cc41cc39b, scope.project.id=e3316e9a169444ac827619608acc9fb7, user.id=a436eb33e8b040d192f1cfc9771fd351) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:45.729291 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b87791-ba0e-4013-8c07-86505fb4025a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:45.730832 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b87791-ba0e-4013-8c07-86505fb4025a None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:45.736932 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 263/523] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jul 27 12:27:45 2022] GET /identity/v3/role_assignments?user.id=a436eb33e8b040d192f1cfc9771fd351&scope.project.id=e3316e9a169444ac827619608acc9fb7&role.id=ec09bb8ea1664640a975563cc41cc39b => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:45.738018 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b87791-ba0e-4013-8c07-86505fb4025a None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:45.751021 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:45.756997 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ad725-8da4-4c12-8982-98d721acd920 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:45.802388 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed4ef9-a13f-4ddb-9997-6cd56e69ff32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:45.803546 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed4ef9-a13f-4ddb-9997-6cd56e69ff32 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:45.804031 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed4ef9-a13f-4ddb-9997-6cd56e69ff32 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:45.804505 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed4ef9-a13f-4ddb-9997-6cd56e69ff32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:45.812894 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed4ef9-a13f-4ddb-9997-6cd56e69ff32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:45.815494 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed4ef9-a13f-4ddb-9997-6cd56e69ff32 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:45.830512 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-99ed4ef9-a13f-4ddb-9997-6cd56e69ff32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 12:27:45.830512 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:45.830512 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:45.830512 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:45.830512 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:45.830512 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:45.830512 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:45.830512 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:45.830512 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:45.830512 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:45.830512 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:45.830512 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:45.830512 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 12:27:45.830512 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 12:27:45.830512 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 12:27:45.831420 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 12:27:45.831420 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:45.831420 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:45.831420 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:45.831420 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:45.831420 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:45.831420 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:45.831420 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:45.831420 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:45.831420 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:45.831420 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:45.831420 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:45.831420 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:45.831420 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:45.831420 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:45.831420 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:45.831420 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:45.832273 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 12:27:45.832273 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 12:27:45.832273 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 12:27:45.832273 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 12:27:45.832273 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 12:27:45.832273 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 12:27:45.832273 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 12:27:45.832273 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:45.834895 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 261/524] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jul 27 12:27:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:45.841745 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed4ef9-a13f-4ddb-9997-6cd56e69ff32 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:45.873521 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b87791-ba0e-4013-8c07-86505fb4025a None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:45.936175 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb5ca4c-bba6-4d5e-85f4-15803236f598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:45.937247 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5ca4c-bba6-4d5e-85f4-15803236f598 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:45.938746 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5ca4c-bba6-4d5e-85f4-15803236f598 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:45.939183 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5ca4c-bba6-4d5e-85f4-15803236f598 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:45.954285 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb5ca4c-bba6-4d5e-85f4-15803236f598 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:45.955935 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb5ca4c-bba6-4d5e-85f4-15803236f598 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:45.969985 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:45.975142 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-3cb5ca4c-bba6-4d5e-85f4-15803236f598 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:45.975142 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:45.975142 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:45.975142 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:45.975142 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:45.975142 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:45.975142 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:45.975142 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:45.975142 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:45.975142 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:45.975142 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:45.975142 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:45.975142 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:27:45.975142 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:27:45.975142 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:27:45.976154 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:27:45.976154 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:45.976154 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:45.976154 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:45.976154 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:45.976154 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:45.976154 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:45.976154 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:45.976154 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:45.976154 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:45.976154 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:45.976154 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:45.976154 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:45.976154 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:45.976154 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:45.976154 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:45.976154 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:45.977021 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:27:45.977021 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:27:45.977021 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:45.977021 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:45.981632 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 264/525] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:27:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:45.982713 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb5ca4c-bba6-4d5e-85f4-15803236f598 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:45.984330 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed4ef9-a13f-4ddb-9997-6cd56e69ff32 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:46.026458 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ae11f-bf50-45e5-b6bf-75a4fbc12ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:46.027419 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ae11f-bf50-45e5-b6bf-75a4fbc12ff4 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:46.027925 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ae11f-bf50-45e5-b6bf-75a4fbc12ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:46.028396 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ae11f-bf50-45e5-b6bf-75a4fbc12ff4 None admin] PATH_INFO: `/v3/projects` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:46.029354 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ae11f-bf50-45e5-b6bf-75a4fbc12ff4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:46.029895 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ae11f-bf50-45e5-b6bf-75a4fbc12ff4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:46.031521 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ae11f-bf50-45e5-b6bf-75a4fbc12ff4 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:46.050329 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 262/526] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jul 27 12:27:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:46.057794 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:46.058118 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ae11f-bf50-45e5-b6bf-75a4fbc12ff4 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:46.116904 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb5ca4c-bba6-4d5e-85f4-15803236f598 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:46.161339 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2cef5-26fe-46e9-a412-2f71aa538bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:46.162001 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2cef5-26fe-46e9-a412-2f71aa538bf0 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:46.162286 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2cef5-26fe-46e9-a412-2f71aa538bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:46.162567 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2cef5-26fe-46e9-a412-2f71aa538bf0 None admin] PATH_INFO: `/v3/domains` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:46.163758 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2cef5-26fe-46e9-a412-2f71aa538bf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:46.164070 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2cef5-26fe-46e9-a412-2f71aa538bf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:46.165742 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2cef5-26fe-46e9-a412-2f71aa538bf0 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:46.186589 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 265/527] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:46.189337 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ae11f-bf50-45e5-b6bf-75a4fbc12ff4 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:46.190573 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2cef5-26fe-46e9-a412-2f71aa538bf0 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:46.232619 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55dbe3-4bf1-4473-bcd4-72416a344009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:46.233176 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55dbe3-4bf1-4473-bcd4-72416a344009 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:46.233459 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55dbe3-4bf1-4473-bcd4-72416a344009 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:46.235698 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55dbe3-4bf1-4473-bcd4-72416a344009 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:46.235698 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f55dbe3-4bf1-4473-bcd4-72416a344009 None admin] RBAC: Adding query filter params (role.id=ec09bb8ea1664640a975563cc41cc39b, scope.project.id=e3316e9a169444ac827619608acc9fb7, user.id=e6ead01964e14f389bcfca4e9d9b6475) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:46.235698 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f55dbe3-4bf1-4473-bcd4-72416a344009 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:46.236859 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f55dbe3-4bf1-4473-bcd4-72416a344009 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:46.243833 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 263/528] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jul 27 12:27:46 2022] GET /identity/v3/role_assignments?user.id=e6ead01964e14f389bcfca4e9d9b6475&scope.project.id=e3316e9a169444ac827619608acc9fb7&role.id=ec09bb8ea1664640a975563cc41cc39b => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:46.313118 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2cef5-26fe-46e9-a412-2f71aa538bf0 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:46.346014 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:46.354973 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887dbd4-6513-4cdf-a8fa-a2152a48b3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:46.355645 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887dbd4-6513-4cdf-a8fa-a2152a48b3c1 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:46.355933 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887dbd4-6513-4cdf-a8fa-a2152a48b3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:46.356219 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887dbd4-6513-4cdf-a8fa-a2152a48b3c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:46.364796 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6887dbd4-6513-4cdf-a8fa-a2152a48b3c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:46.366644 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6887dbd4-6513-4cdf-a8fa-a2152a48b3c1 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:46.379891 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-6887dbd4-6513-4cdf-a8fa-a2152a48b3c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 12:27:46.379891 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:46.379891 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:46.379891 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:46.379891 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:46.379891 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:46.379891 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:46.379891 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:46.379891 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:46.379891 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:46.379891 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:46.379891 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:46.379891 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 12:27:46.379891 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 12:27:46.379891 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 12:27:46.380813 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 12:27:46.380813 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:46.380813 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:46.380813 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:46.380813 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:46.380813 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:46.380813 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:46.380813 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:46.380813 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:46.380813 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:46.380813 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:46.380813 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:46.380813 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:46.380813 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:46.380813 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:46.380813 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:46.380813 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:46.381681 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 12:27:46.381681 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 12:27:46.381681 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 12:27:46.381681 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 12:27:46.381681 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 12:27:46.381681 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 12:27:46.381681 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 12:27:46.381681 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:46.381681 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 266/529] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jul 27 12:27:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:46.389084 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55dbe3-4bf1-4473-bcd4-72416a344009 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:46.404255 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:46.502870 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55dbe3-4bf1-4473-bcd4-72416a344009 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:46.537789 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d9c74-3ff9-46fd-953c-3ac5b5799d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:46.538465 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d9c74-3ff9-46fd-953c-3ac5b5799d6c None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:46.538749 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d9c74-3ff9-46fd-953c-3ac5b5799d6c None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:46.539077 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d9c74-3ff9-46fd-953c-3ac5b5799d6c None admin] PATH_INFO: `/v3/projects` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:46.539957 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7d9c74-3ff9-46fd-953c-3ac5b5799d6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:46.540333 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7d9c74-3ff9-46fd-953c-3ac5b5799d6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:46.541805 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7d9c74-3ff9-46fd-953c-3ac5b5799d6c None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:46.555466 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 264/530] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jul 27 12:27:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:46.563672 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887dbd4-6513-4cdf-a8fa-a2152a48b3c1 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:46.668049 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887dbd4-6513-4cdf-a8fa-a2152a48b3c1 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:46.702764 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0dc658-4cb9-4028-a000-93a90a4a2dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:46.703453 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0dc658-4cb9-4028-a000-93a90a4a2dbb None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:46.703827 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0dc658-4cb9-4028-a000-93a90a4a2dbb None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:46.704165 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0dc658-4cb9-4028-a000-93a90a4a2dbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:46.705013 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0dc658-4cb9-4028-a000-93a90a4a2dbb None admin] RBAC: Adding query filter params (role.id=ec09bb8ea1664640a975563cc41cc39b, scope.project.id=e3316e9a169444ac827619608acc9fb7, user.id=645587202a91426c98f86abdcddce8cd) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:46.705390 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0dc658-4cb9-4028-a000-93a90a4a2dbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:46.706914 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0dc658-4cb9-4028-a000-93a90a4a2dbb None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:46.712828 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 267/531] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jul 27 12:27:46 2022] GET /identity/v3/role_assignments?user.id=645587202a91426c98f86abdcddce8cd&scope.project.id=e3316e9a169444ac827619608acc9fb7&role.id=ec09bb8ea1664640a975563cc41cc39b => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:47.444597 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456644df-7954-439c-a277-1232c7b44b72 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:47.445495 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456644df-7954-439c-a277-1232c7b44b72 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:47.445942 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456644df-7954-439c-a277-1232c7b44b72 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:47.448036 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 265/532] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:47.454126 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfdfb22-b8d4-437d-9b3a-751b1190d32f None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:47.454944 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfdfb22-b8d4-437d-9b3a-751b1190d32f None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:47.455370 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfdfb22-b8d4-437d-9b3a-751b1190d32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:47.474981 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-abfdfb22-b8d4-437d-9b3a-751b1190d32f None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:47.476410 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-abfdfb22-b8d4-437d-9b3a-751b1190d32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:47.519409 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:47.549627 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 268/533] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 12:27:47.573002 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456644df-7954-439c-a277-1232c7b44b72 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:47.646905 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:47.685688 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456644df-7954-439c-a277-1232c7b44b72 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:47.721957 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803e07e-49db-4bf3-826e-724f5a61254a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:47.722525 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803e07e-49db-4bf3-826e-724f5a61254a None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:47.722815 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803e07e-49db-4bf3-826e-724f5a61254a None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:47.723098 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803e07e-49db-4bf3-826e-724f5a61254a None admin] PATH_INFO: `/v3/roles/service` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:47.733884 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6803e07e-49db-4bf3-826e-724f5a61254a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:47.739403 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-6803e07e-49db-4bf3-826e-724f5a61254a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 12:27:47.739403 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:47.739403 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:47.739403 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:47.739403 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:47.739403 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:47.739403 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:47.739403 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:47.739403 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:47.739403 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:47.739403 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:47.739403 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:47.739403 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:47.739403 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:47.739403 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:47.739403 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:47.740266 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:47.740266 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:47.740266 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:47.740266 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:47.740266 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:47.740266 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:47.740266 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:47.740266 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:47.740266 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:47.740266 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:47.740266 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:47.740266 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:47.740266 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:47.740266 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:47.740266 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:47.740266 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:47.741762 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:47.741762 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:47.741762 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:47.741762 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:47.741762 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:47.741762 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:47.741762 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:47.741762 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:47.741762 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:47.741762 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:47.741762 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 12:27:47.741762 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:47.741762 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 266/534] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jul 27 12:27:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:47.746873 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfdfb22-b8d4-437d-9b3a-751b1190d32f None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:47.852100 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfdfb22-b8d4-437d-9b3a-751b1190d32f None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:47.890637 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3656f538-27f1-482d-beb8-050b59b55aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:47.892153 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656f538-27f1-482d-beb8-050b59b55aec None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:47.892631 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656f538-27f1-482d-beb8-050b59b55aec None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:47.893096 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656f538-27f1-482d-beb8-050b59b55aec None admin] PATH_INFO: `/v3/roles` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:47.894057 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3656f538-27f1-482d-beb8-050b59b55aec None admin] RBAC: Adding query filter params (name=service) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:47.894572 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3656f538-27f1-482d-beb8-050b59b55aec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:47.896129 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3656f538-27f1-482d-beb8-050b59b55aec None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:47.905557 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 269/535] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jul 27 12:27:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:27:47.910957 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803e07e-49db-4bf3-826e-724f5a61254a None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:48.020111 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803e07e-49db-4bf3-826e-724f5a61254a None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:48.050231 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:48.056200 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7cac2-ea7c-4173-af61-ea9d651c9707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:48.057245 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7cac2-ea7c-4173-af61-ea9d651c9707 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:48.057970 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7cac2-ea7c-4173-af61-ea9d651c9707 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:48.058629 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7cac2-ea7c-4173-af61-ea9d651c9707 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:48.069866 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7cac2-ea7c-4173-af61-ea9d651c9707 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:48.071325 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7cac2-ea7c-4173-af61-ea9d651c9707 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:48.073936 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6927bb-3495-4599-94f8-fd7200f0d169 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:48.074236 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6927bb-3495-4599-94f8-fd7200f0d169 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:48.074530 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6927bb-3495-4599-94f8-fd7200f0d169 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:48.076135 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 270/536] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 12:27:48.081004 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566a07a-d599-49c4-b1f4-f6a3bcf3571d None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:48.081297 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566a07a-d599-49c4-b1f4-f6a3bcf3571d None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:48.081583 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566a07a-d599-49c4-b1f4-f6a3bcf3571d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:48.086928 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-d3a7cac2-ea7c-4173-af61-ea9d651c9707 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:48.086928 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:48.086928 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:48.086928 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:48.086928 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:48.086928 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:48.086928 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:48.086928 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:48.086928 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:48.086928 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:48.086928 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:48.086928 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:48.086928 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:27:48.086928 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:27:48.086928 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:27:48.087752 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:27:48.087752 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:48.087752 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:48.087752 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:48.087752 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:48.087752 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:48.087752 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:48.087752 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:48.087752 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:48.087752 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:48.087752 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:48.087752 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:48.087752 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:48.087752 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:48.087752 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:48.087752 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:48.087752 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:48.089660 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:27:48.089660 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:27:48.089660 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:48.089660 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:48.089660 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 267/537] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:27:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:48.093635 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7cac2-ea7c-4173-af61-ea9d651c9707 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:48.103128 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-0566a07a-d599-49c4-b1f4-f6a3bcf3571d None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:48.104324 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-0566a07a-d599-49c4-b1f4-f6a3bcf3571d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:48.141782 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:48.194546 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 271/538] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 12:27:48.210720 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7cac2-ea7c-4173-af61-ea9d651c9707 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:48.217612 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0566a07a-d599-49c4-b1f4-f6a3bcf3571d None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:48.256695 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ce059-ea80-4f26-8432-9c768847a4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:48.257937 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ce059-ea80-4f26-8432-9c768847a4d2 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:48.258431 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ce059-ea80-4f26-8432-9c768847a4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:48.258917 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ce059-ea80-4f26-8432-9c768847a4d2 None admin] PATH_INFO: `/v3/domains` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:48.259840 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ce059-ea80-4f26-8432-9c768847a4d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:48.260347 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ce059-ea80-4f26-8432-9c768847a4d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:48.262024 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ce059-ea80-4f26-8432-9c768847a4d2 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:48.276050 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 268/539] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:27:48.282366 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ce059-ea80-4f26-8432-9c768847a4d2 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:48.326404 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0566a07a-d599-49c4-b1f4-f6a3bcf3571d None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:48.331412 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:48.361979 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe703b-901a-4633-8708-a4bb27d5b25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:48.362628 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe703b-901a-4633-8708-a4bb27d5b25f None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:48.362960 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe703b-901a-4633-8708-a4bb27d5b25f None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:48.363243 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe703b-901a-4633-8708-a4bb27d5b25f None admin] PATH_INFO: `/v3/roles/service` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:48.374936 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe703b-901a-4633-8708-a4bb27d5b25f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:48.379854 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-8ebe703b-901a-4633-8708-a4bb27d5b25f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 12:27:48.379854 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:48.379854 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:48.379854 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:48.379854 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:48.379854 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:48.379854 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:48.379854 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:48.379854 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:48.379854 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:48.379854 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:48.379854 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:48.379854 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:48.379854 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:48.379854 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:48.379854 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:48.380739 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:48.380739 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:48.380739 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:48.380739 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:48.380739 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:48.380739 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:48.380739 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:48.380739 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:48.380739 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:48.380739 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:48.380739 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:48.380739 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:48.380739 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:48.380739 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:48.380739 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:48.380739 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:48.381566 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:48.381566 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:48.381566 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:48.381566 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:48.381566 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:48.381566 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:48.381566 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:48.381566 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:48.381566 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:48.381566 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:48.381566 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 12:27:48.381566 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:48.385845 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 272/540] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jul 27 12:27:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 12:27:48.386966 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe703b-901a-4633-8708-a4bb27d5b25f None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:48.402583 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ce059-ea80-4f26-8432-9c768847a4d2 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:48.416916 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:48.444555 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2bbebe-fc01-4c21-873f-1c14f8f6035d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:48.445688 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2bbebe-fc01-4c21-873f-1c14f8f6035d None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:48.446690 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2bbebe-fc01-4c21-873f-1c14f8f6035d None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:48.447236 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2bbebe-fc01-4c21-873f-1c14f8f6035d None admin] PATH_INFO: `/v3/users/nova` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:48.455924 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2bbebe-fc01-4c21-873f-1c14f8f6035d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:48.457863 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2bbebe-fc01-4c21-873f-1c14f8f6035d None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:48.470744 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-7d2bbebe-fc01-4c21-873f-1c14f8f6035d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 12:27:48.470744 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:48.470744 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:48.470744 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:48.470744 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:48.470744 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:48.470744 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:48.470744 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:48.470744 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:48.470744 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:48.470744 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:48.470744 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:48.470744 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 12:27:48.470744 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 12:27:48.470744 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 12:27:48.470744 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 12:27:48.471794 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:48.471794 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:48.471794 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 12:27:48.471794 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:27:48.471794 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 12:27:48.471794 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:27:48.471794 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:48.471794 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:48.471794 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:48.471794 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:48.471794 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:48.471794 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:48.471794 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:48.471794 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:48.471794 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:48.471794 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:48.471794 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:48.471794 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:48.472693 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:48.472693 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:48.472693 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 12:27:48.472693 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 12:27:48.472693 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 12:27:48.472693 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 12:27:48.472693 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 12:27:48.472693 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 12:27:48.472693 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 12:27:48.472693 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:48.475061 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 269/541] 10.222.0.55 () {56 vars in 1093 bytes} [Wed Jul 27 12:27:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:48.480729 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2bbebe-fc01-4c21-873f-1c14f8f6035d None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:48.492737 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe703b-901a-4633-8708-a4bb27d5b25f None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:48.532075 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d53c7-3715-4563-bbc7-a24d38221249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:48.532627 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d53c7-3715-4563-bbc7-a24d38221249 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:48.532910 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d53c7-3715-4563-bbc7-a24d38221249 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:48.533185 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d53c7-3715-4563-bbc7-a24d38221249 None admin] PATH_INFO: `/v3/roles` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:48.534032 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d53c7-3715-4563-bbc7-a24d38221249 None admin] RBAC: Adding query filter params (name=service) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:48.534333 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d53c7-3715-4563-bbc7-a24d38221249 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:48.536035 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d53c7-3715-4563-bbc7-a24d38221249 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:48.550266 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 273/542] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jul 27 12:27:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:27:48.551775 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d53c7-3715-4563-bbc7-a24d38221249 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:48.607411 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2bbebe-fc01-4c21-873f-1c14f8f6035d None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:48.609532 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:48.650009 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82358eb4-e7f1-4dd4-abb8-57e235d64315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:48.651092 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82358eb4-e7f1-4dd4-abb8-57e235d64315 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:48.651583 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82358eb4-e7f1-4dd4-abb8-57e235d64315 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:48.652136 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82358eb4-e7f1-4dd4-abb8-57e235d64315 None admin] PATH_INFO: `/v3/users` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:48.653144 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82358eb4-e7f1-4dd4-abb8-57e235d64315 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:48.653681 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82358eb4-e7f1-4dd4-abb8-57e235d64315 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:48.654845 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:48.656807 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82358eb4-e7f1-4dd4-abb8-57e235d64315 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:48.668249 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d53c7-3715-4563-bbc7-a24d38221249 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:48.683142 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 270/543] 10.222.0.55 () {56 vars in 1133 bytes} [Wed Jul 27 12:27:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:27:48.683142 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662f818-c966-424f-b5ba-a4ddb60d17bb None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:48.683142 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662f818-c966-424f-b5ba-a4ddb60d17bb None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:48.683142 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662f818-c966-424f-b5ba-a4ddb60d17bb None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:48.687842 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 271/544] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:48.687842 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662f818-c966-424f-b5ba-a4ddb60d17bb None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:48.705656 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979533a-a1c5-4465-b812-cc217b227475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:48.706286 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979533a-a1c5-4465-b812-cc217b227475 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:48.706572 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979533a-a1c5-4465-b812-cc217b227475 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:48.706851 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979533a-a1c5-4465-b812-cc217b227475 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:48.718436 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979533a-a1c5-4465-b812-cc217b227475 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:48.719944 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979533a-a1c5-4465-b812-cc217b227475 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:48.736479 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-6979533a-a1c5-4465-b812-cc217b227475 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:48.736479 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:48.736479 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:48.736479 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:48.736479 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:48.736479 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:48.736479 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:48.736479 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:48.736479 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:48.736479 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:48.736479 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:48.736479 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:48.736479 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:27:48.736479 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:27:48.736479 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:27:48.737514 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:27:48.737514 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:48.737514 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:48.737514 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:48.737514 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:48.737514 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:48.737514 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:48.737514 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:48.737514 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:48.737514 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:48.737514 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:48.737514 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:48.737514 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:48.737514 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:48.737514 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:48.737514 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:48.737514 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:48.738716 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:27:48.738716 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:27:48.738716 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:48.738716 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:48.738716 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 274/545] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:27:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:48.744035 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffeea46-e083-43f3-8a3f-e101cff6669a None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:48.744317 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffeea46-e083-43f3-8a3f-e101cff6669a None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:48.744589 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffeea46-e083-43f3-8a3f-e101cff6669a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:48.764096 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-cffeea46-e083-43f3-8a3f-e101cff6669a None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:48.765401 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-cffeea46-e083-43f3-8a3f-e101cff6669a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:48.810851 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662f818-c966-424f-b5ba-a4ddb60d17bb None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:48.851376 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 275/546] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:27:48.852552 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffeea46-e083-43f3-8a3f-e101cff6669a None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:48.862325 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e64f33-65a8-4641-b098-f70384d97b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:48.862984 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e64f33-65a8-4641-b098-f70384d97b66 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:48.863272 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e64f33-65a8-4641-b098-f70384d97b66 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:48.863553 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e64f33-65a8-4641-b098-f70384d97b66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:48.882992 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e64f33-65a8-4641-b098-f70384d97b66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:48.884787 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e64f33-65a8-4641-b098-f70384d97b66 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:48.900662 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-79e64f33-65a8-4641-b098-f70384d97b66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:48.900662 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:48.900662 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:48.900662 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:48.900662 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:48.900662 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:48.900662 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:48.900662 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:48.900662 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:48.900662 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:48.900662 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:48.900662 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:48.900662 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:27:48.900662 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:27:48.900662 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:27:48.901551 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:27:48.901551 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:48.901551 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:48.901551 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:48.901551 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:48.901551 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:48.901551 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:48.901551 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:48.901551 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:48.901551 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:48.901551 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:48.901551 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:48.901551 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:48.901551 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:48.901551 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:48.901551 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:48.901551 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:48.902655 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:27:48.902655 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:27:48.902655 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:48.902655 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:48.906318 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 272/547] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:27:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:48.907639 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e64f33-65a8-4641-b098-f70384d97b66 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:48.925504 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:48.936616 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:48.968198 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffeea46-e083-43f3-8a3f-e101cff6669a None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:49.002522 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86278111-f172-4b7b-9f76-ac8241d0adb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:49.003327 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86278111-f172-4b7b-9f76-ac8241d0adb3 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:49.003606 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86278111-f172-4b7b-9f76-ac8241d0adb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:49.003879 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86278111-f172-4b7b-9f76-ac8241d0adb3 None admin] PATH_INFO: `/v3/domains` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:49.004556 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86278111-f172-4b7b-9f76-ac8241d0adb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:49.004856 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86278111-f172-4b7b-9f76-ac8241d0adb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:49.006265 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86278111-f172-4b7b-9f76-ac8241d0adb3 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:49.012254 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e64f33-65a8-4641-b098-f70384d97b66 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:49.017029 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 276/548] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:49.017890 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86278111-f172-4b7b-9f76-ac8241d0adb3 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:49.045982 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0806e-6168-46d7-b683-c44bcbe50519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:49.046620 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0806e-6168-46d7-b683-c44bcbe50519 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:49.046966 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0806e-6168-46d7-b683-c44bcbe50519 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:49.047250 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0806e-6168-46d7-b683-c44bcbe50519 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:49.057643 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0806e-6168-46d7-b683-c44bcbe50519 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:49.062992 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-03b0806e-6168-46d7-b683-c44bcbe50519 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 12:27:49.062992 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:49.062992 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:49.062992 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:49.062992 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:49.062992 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:49.062992 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:49.062992 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:49.062992 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:49.062992 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:49.062992 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:49.062992 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:49.062992 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:49.062992 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:49.062992 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:49.062992 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:49.064057 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:49.064057 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:49.064057 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:49.064057 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:49.064057 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:49.064057 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:49.064057 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:49.064057 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:49.064057 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:49.064057 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:49.064057 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:49.064057 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:49.064057 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:49.064057 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:49.064057 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:49.064057 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:49.064861 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:49.064861 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:49.064861 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:49.064861 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:49.064861 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:49.064861 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:49.064861 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:49.064861 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:49.064861 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:49.064861 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:49.064861 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 12:27:49.064861 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:49.064861 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 273/549] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jul 27 12:27:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:49.065524 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3bf27-8541-42a4-b471-d10dfaa2c899 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:49.065785 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3bf27-8541-42a4-b471-d10dfaa2c899 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:49.066063 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3bf27-8541-42a4-b471-d10dfaa2c899 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:49.067291 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 274/550] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:49.067984 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3bf27-8541-42a4-b471-d10dfaa2c899 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:49.122816 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86278111-f172-4b7b-9f76-ac8241d0adb3 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:49.136734 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:49.150323 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:49.157714 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad531c-a489-4ce3-86bf-fec10d9bc73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:49.158360 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad531c-a489-4ce3-86bf-fec10d9bc73a None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:49.158645 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad531c-a489-4ce3-86bf-fec10d9bc73a None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:49.158924 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad531c-a489-4ce3-86bf-fec10d9bc73a None admin] PATH_INFO: `/v3/domains` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:49.159619 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad531c-a489-4ce3-86bf-fec10d9bc73a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:49.159923 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad531c-a489-4ce3-86bf-fec10d9bc73a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:49.161292 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad531c-a489-4ce3-86bf-fec10d9bc73a None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:49.170005 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3bf27-8541-42a4-b471-d10dfaa2c899 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:49.172664 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 277/551] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:27:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:49.173455 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad531c-a489-4ce3-86bf-fec10d9bc73a None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:49.208260 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241e614-50e9-4794-9c8f-5f24ddccc197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:49.208900 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241e614-50e9-4794-9c8f-5f24ddccc197 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:49.209182 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241e614-50e9-4794-9c8f-5f24ddccc197 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:49.209459 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241e614-50e9-4794-9c8f-5f24ddccc197 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:49.216397 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3241e614-50e9-4794-9c8f-5f24ddccc197 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:49.217852 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3241e614-50e9-4794-9c8f-5f24ddccc197 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:49.229288 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-3241e614-50e9-4794-9c8f-5f24ddccc197 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 12:27:49.229288 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:49.229288 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:49.229288 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:49.229288 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:49.229288 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:49.229288 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:49.229288 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:49.229288 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:49.229288 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:49.229288 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:49.229288 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:49.229288 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 12:27:49.229288 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 12:27:49.229288 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 12:27:49.229288 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 12:27:49.230587 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:49.230587 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:49.230587 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 12:27:49.230587 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:27:49.230587 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 12:27:49.230587 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:27:49.230587 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:49.230587 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:49.230587 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:49.230587 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:49.230587 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:49.230587 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:49.230587 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:49.230587 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:49.230587 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:49.230587 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:49.230587 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:49.230587 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:49.231690 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:49.231690 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:49.231690 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 12:27:49.231690 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 12:27:49.231690 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 12:27:49.231690 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 12:27:49.231690 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 12:27:49.231690 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 12:27:49.231690 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 12:27:49.231690 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:49.231690 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 275/552] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:27:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:49.232405 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96320833-1e9a-4dbd-a22d-fa6760ca8423 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:49.232405 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96320833-1e9a-4dbd-a22d-fa6760ca8423 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:49.232405 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96320833-1e9a-4dbd-a22d-fa6760ca8423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:49.250157 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-96320833-1e9a-4dbd-a22d-fa6760ca8423 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:49.252033 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-96320833-1e9a-4dbd-a22d-fa6760ca8423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:49.275657 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad531c-a489-4ce3-86bf-fec10d9bc73a None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:49.308150 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d91f9-781c-4c36-a17f-32f5359a53f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:49.308767 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d91f9-781c-4c36-a17f-32f5359a53f2 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:49.309040 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d91f9-781c-4c36-a17f-32f5359a53f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:49.309309 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d91f9-781c-4c36-a17f-32f5359a53f2 None admin] PATH_INFO: `/v3/roles` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:49.310054 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d91f9-781c-4c36-a17f-32f5359a53f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:49.310353 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d91f9-781c-4c36-a17f-32f5359a53f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:49.311697 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d91f9-781c-4c36-a17f-32f5359a53f2 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:49.317983 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 276/553] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:27:49.318744 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96320833-1e9a-4dbd-a22d-fa6760ca8423 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:49.324463 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 278/554] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jul 27 12:27:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:49.324463 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d91f9-781c-4c36-a17f-32f5359a53f2 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:49.375079 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:49.385744 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:49.422438 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d91f9-781c-4c36-a17f-32f5359a53f2 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:49.424699 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96320833-1e9a-4dbd-a22d-fa6760ca8423 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:49.454550 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ef347-319e-4a0d-80ee-d52c35a4fc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:49.455453 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ef347-319e-4a0d-80ee-d52c35a4fc72 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:49.455729 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ef347-319e-4a0d-80ee-d52c35a4fc72 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:49.456005 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ef347-319e-4a0d-80ee-d52c35a4fc72 None admin] PATH_INFO: `/v3/users` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:49.456785 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ef347-319e-4a0d-80ee-d52c35a4fc72 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:49.457092 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ef347-319e-4a0d-80ee-d52c35a4fc72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:49.457715 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5e079-bb41-4635-aef0-8bb3a0a41748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:49.458355 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5e079-bb41-4635-aef0-8bb3a0a41748 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:49.458550 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ef347-319e-4a0d-80ee-d52c35a4fc72 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:49.458642 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5e079-bb41-4635-aef0-8bb3a0a41748 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:49.458908 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5e079-bb41-4635-aef0-8bb3a0a41748 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:49.465606 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5e079-bb41-4635-aef0-8bb3a0a41748 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:49.467085 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5e079-bb41-4635-aef0-8bb3a0a41748 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:49.475803 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 279/555] 10.222.0.55 () {56 vars in 1137 bytes} [Wed Jul 27 12:27:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:49.476608 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ef347-319e-4a0d-80ee-d52c35a4fc72 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:49.478918 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-38e5e079-bb41-4635-aef0-8bb3a0a41748 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 12:27:49.478918 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:49.478918 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:49.478918 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:49.478918 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:49.478918 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:49.478918 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:49.478918 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:49.478918 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:49.478918 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:49.478918 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:49.478918 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:49.478918 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 12:27:49.478918 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 12:27:49.478918 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 12:27:49.479952 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 12:27:49.479952 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:49.479952 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:49.479952 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:49.479952 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:49.479952 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:49.479952 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:49.479952 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:49.479952 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:49.479952 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:49.479952 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:49.479952 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:49.479952 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:49.479952 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:49.479952 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:49.479952 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:49.479952 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:49.480859 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 12:27:49.480859 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 12:27:49.480859 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 12:27:49.480859 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 12:27:49.480859 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 12:27:49.480859 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 12:27:49.480859 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 12:27:49.480859 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:49.480859 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 277/556] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jul 27 12:27:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:49.481331 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5e079-bb41-4635-aef0-8bb3a0a41748 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:49.575838 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ef347-319e-4a0d-80ee-d52c35a4fc72 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:49.578463 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5e079-bb41-4635-aef0-8bb3a0a41748 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:49.587436 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:49.600758 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:49.610887 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be767c9d-c780-4c00-bf6e-1818f76193f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:49.611533 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be767c9d-c780-4c00-bf6e-1818f76193f7 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:49.611821 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be767c9d-c780-4c00-bf6e-1818f76193f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:49.612202 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be767c9d-c780-4c00-bf6e-1818f76193f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:49.613665 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa90c13-ef34-4aa7-a1df-1576f6ce25e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:49.614473 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa90c13-ef34-4aa7-a1df-1576f6ce25e3 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:49.615075 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa90c13-ef34-4aa7-a1df-1576f6ce25e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:49.615358 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa90c13-ef34-4aa7-a1df-1576f6ce25e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:49.622265 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be767c9d-c780-4c00-bf6e-1818f76193f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:49.623755 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be767c9d-c780-4c00-bf6e-1818f76193f7 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:49.627623 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa90c13-ef34-4aa7-a1df-1576f6ce25e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:49.632977 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-cfa90c13-ef34-4aa7-a1df-1576f6ce25e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 12:27:49.632977 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:49.632977 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:49.632977 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:49.632977 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:49.632977 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:49.632977 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:49.632977 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:49.632977 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:49.632977 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:49.632977 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:49.632977 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:49.632977 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:49.632977 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:49.632977 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:49.632977 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:49.633915 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:49.633915 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:49.633915 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:49.633915 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:49.633915 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:49.633915 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:49.633915 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:49.633915 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:49.633915 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:49.633915 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:49.633915 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:49.633915 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:49.633915 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:49.633915 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:49.633915 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:49.633915 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:49.634737 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:49.634737 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:49.634737 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:49.634737 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:49.634737 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:49.634737 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:49.634737 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:49.634737 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:49.634737 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:49.634737 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:49.634737 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 12:27:49.634737 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:49.634737 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 278/557] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jul 27 12:27:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:49.635414 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa90c13-ef34-4aa7-a1df-1576f6ce25e3 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:49.644799 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-be767c9d-c780-4c00-bf6e-1818f76193f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:49.644799 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:49.644799 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:49.644799 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:49.644799 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:49.644799 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:49.644799 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:49.644799 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:49.644799 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:49.644799 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:49.644799 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:49.644799 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:49.644799 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:27:49.644799 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:27:49.644799 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:27:49.646293 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:27:49.646293 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:49.646293 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:49.646293 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:49.646293 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:49.646293 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:49.646293 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:49.646293 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:49.646293 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:49.646293 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:49.646293 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:49.646293 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:49.646293 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:49.646293 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:49.646293 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:49.646293 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:49.646293 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:49.647198 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:27:49.647198 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:27:49.647198 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:49.647198 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:49.647198 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 280/558] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:27:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:49.647507 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be767c9d-c780-4c00-bf6e-1818f76193f7 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:49.741644 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa90c13-ef34-4aa7-a1df-1576f6ce25e3 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:49.756654 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be767c9d-c780-4c00-bf6e-1818f76193f7 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:49.775046 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d921d-af0f-41bb-af75-b46481a183bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:49.775677 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d921d-af0f-41bb-af75-b46481a183bc None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:49.775962 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d921d-af0f-41bb-af75-b46481a183bc None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:49.776242 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d921d-af0f-41bb-af75-b46481a183bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:49.786860 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d921d-af0f-41bb-af75-b46481a183bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:49.788305 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d921d-af0f-41bb-af75-b46481a183bc None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:49.789567 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac85797-92f7-40a9-b9bf-d65b8a2f8906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:49.790202 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac85797-92f7-40a9-b9bf-d65b8a2f8906 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:49.790487 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac85797-92f7-40a9-b9bf-d65b8a2f8906 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:49.790765 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac85797-92f7-40a9-b9bf-d65b8a2f8906 None admin] PATH_INFO: `/v3/projects` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:49.791515 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac85797-92f7-40a9-b9bf-d65b8a2f8906 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:49.791824 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac85797-92f7-40a9-b9bf-d65b8a2f8906 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:49.793252 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac85797-92f7-40a9-b9bf-d65b8a2f8906 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:49.802460 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-ef4d921d-af0f-41bb-af75-b46481a183bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:49.802460 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:49.802460 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:49.802460 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:49.802460 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:49.802460 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:49.802460 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:49.802460 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:49.802460 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:49.802460 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:49.802460 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:49.802460 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:49.802460 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:27:49.802460 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:27:49.802460 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:27:49.803578 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:27:49.803578 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:49.803578 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:49.803578 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:49.803578 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:49.803578 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:49.803578 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:49.803578 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:49.803578 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:49.803578 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:49.803578 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:49.803578 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:49.803578 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:49.803578 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:49.803578 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:49.803578 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:49.803578 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:49.804658 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:27:49.804658 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:27:49.804658 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:49.804658 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:49.804658 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 279/559] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:27:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:49.804658 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d921d-af0f-41bb-af75-b46481a183bc None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:49.807241 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 281/560] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jul 27 12:27:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:49.808126 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac85797-92f7-40a9-b9bf-d65b8a2f8906 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:49.835092 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:49.842514 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:49.913155 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d921d-af0f-41bb-af75-b46481a183bc None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:49.915162 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac85797-92f7-40a9-b9bf-d65b8a2f8906 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:49.946728 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2dc10-7a72-407f-9f90-7cd6834b3198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:49.947338 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2dc10-7a72-407f-9f90-7cd6834b3198 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:49.947624 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2dc10-7a72-407f-9f90-7cd6834b3198 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:49.947901 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2dc10-7a72-407f-9f90-7cd6834b3198 None admin] PATH_INFO: `/v3/roles` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:49.948613 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2dc10-7a72-407f-9f90-7cd6834b3198 None admin] RBAC: Adding query filter params (name=service) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:49.948921 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2dc10-7a72-407f-9f90-7cd6834b3198 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:49.950304 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2dc10-7a72-407f-9f90-7cd6834b3198 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:49.950732 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4798a-e6ea-4fc4-8cab-785b3cb8224e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:49.951445 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4798a-e6ea-4fc4-8cab-785b3cb8224e None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:49.951796 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4798a-e6ea-4fc4-8cab-785b3cb8224e None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:49.952079 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4798a-e6ea-4fc4-8cab-785b3cb8224e None admin] PATH_INFO: `/v3/domains` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:49.952768 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d4798a-e6ea-4fc4-8cab-785b3cb8224e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:49.953071 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d4798a-e6ea-4fc4-8cab-785b3cb8224e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:49.954497 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d4798a-e6ea-4fc4-8cab-785b3cb8224e None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:49.962723 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 280/561] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jul 27 12:27:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:49.962723 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2dc10-7a72-407f-9f90-7cd6834b3198 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:49.976816 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 282/562] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:27:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:49.976816 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4798a-e6ea-4fc4-8cab-785b3cb8224e None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:50.053160 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:50.055424 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:50.062033 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2dc10-7a72-407f-9f90-7cd6834b3198 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:50.071917 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4798a-e6ea-4fc4-8cab-785b3cb8224e None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:50.096335 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17db7b2-68a4-4d61-8556-6ee3da333fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:50.096965 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17db7b2-68a4-4d61-8556-6ee3da333fbd None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:50.097253 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17db7b2-68a4-4d61-8556-6ee3da333fbd None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:50.097532 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17db7b2-68a4-4d61-8556-6ee3da333fbd None admin] PATH_INFO: `/v3/domains` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:50.098247 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17db7b2-68a4-4d61-8556-6ee3da333fbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:50.098559 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17db7b2-68a4-4d61-8556-6ee3da333fbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:50.099914 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17db7b2-68a4-4d61-8556-6ee3da333fbd None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:50.105579 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0173f1-4e62-44f6-96eb-b0e923f26b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:50.106263 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0173f1-4e62-44f6-96eb-b0e923f26b65 None admin] REQUEST_METHOD: `PUT` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:50.106545 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0173f1-4e62-44f6-96eb-b0e923f26b65 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:50.106817 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0173f1-4e62-44f6-96eb-b0e923f26b65 None admin] PATH_INFO: `/v3/projects/e3316e9a169444ac827619608acc9fb7/users/36964c4644584d4282b04596ad20717c/roles/ec09bb8ea1664640a975563cc41cc39b` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:50.111405 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 281/563] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:27:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:50.112181 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17db7b2-68a4-4d61-8556-6ee3da333fbd None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:50.121275 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0173f1-4e62-44f6-96eb-b0e923f26b65 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3316e9a169444ac827619608acc9fb7, user_id=36964c4644584d4282b04596ad20717c, role_id=ec09bb8ea1664640a975563cc41cc39b)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:50.122746 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0173f1-4e62-44f6-96eb-b0e923f26b65 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:50.135401 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 283/564] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jul 27 12:27:49 2022] PUT /identity/v3/projects/e3316e9a169444ac827619608acc9fb7/users/36964c4644584d4282b04596ad20717c/roles/ec09bb8ea1664640a975563cc41cc39b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 12:27:50.136179 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0173f1-4e62-44f6-96eb-b0e923f26b65 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:50.228197 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17db7b2-68a4-4d61-8556-6ee3da333fbd None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:50.253565 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0173f1-4e62-44f6-96eb-b0e923f26b65 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:50.267790 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c5977-984b-4092-a8f8-92bd3b59715f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:50.268563 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c5977-984b-4092-a8f8-92bd3b59715f None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:50.268846 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c5977-984b-4092-a8f8-92bd3b59715f None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:50.269234 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c5977-984b-4092-a8f8-92bd3b59715f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:50.280385 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c5977-984b-4092-a8f8-92bd3b59715f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:50.281951 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c5977-984b-4092-a8f8-92bd3b59715f None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:50.286291 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:50.293058 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a914ae5-6ece-4912-be21-17c703f550c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:50.293749 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a914ae5-6ece-4912-be21-17c703f550c5 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:50.294031 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a914ae5-6ece-4912-be21-17c703f550c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:50.294301 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a914ae5-6ece-4912-be21-17c703f550c5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:50.299379 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-b27c5977-984b-4092-a8f8-92bd3b59715f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:50.299379 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:50.299379 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:50.299379 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:50.299379 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:50.299379 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:50.299379 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:50.299379 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:50.299379 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:50.299379 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:50.299379 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:50.299379 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:50.299379 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:27:50.299379 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:27:50.299379 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:27:50.300384 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:27:50.300384 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:50.300384 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:50.300384 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:50.300384 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:50.300384 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:50.300384 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:50.300384 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:50.300384 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:50.300384 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:50.300384 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:50.300384 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:50.300384 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:50.300384 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:50.300384 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:50.300384 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:50.300384 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:50.301350 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:27:50.301350 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:27:50.301350 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:50.301350 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:50.303315 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a914ae5-6ece-4912-be21-17c703f550c5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:50.304739 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a914ae5-6ece-4912-be21-17c703f550c5 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:50.305455 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 282/565] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:27:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:50.306182 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c5977-984b-4092-a8f8-92bd3b59715f None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:50.318717 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-8a914ae5-6ece-4912-be21-17c703f550c5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 12:27:50.318717 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:50.318717 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:50.318717 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:50.318717 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:50.318717 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:50.318717 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:50.318717 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:50.318717 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:50.318717 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:50.318717 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:50.318717 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:50.318717 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 12:27:50.318717 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 12:27:50.318717 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 12:27:50.318717 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 12:27:50.319755 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:50.319755 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:50.319755 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 12:27:50.319755 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:27:50.319755 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 12:27:50.319755 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:27:50.319755 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:50.319755 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:50.319755 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:50.319755 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:50.319755 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:50.319755 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:50.319755 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:50.319755 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:50.319755 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:50.319755 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:50.319755 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:50.319755 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:50.321853 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:50.321853 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:50.321853 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 12:27:50.321853 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 12:27:50.321853 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 12:27:50.321853 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 12:27:50.321853 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 12:27:50.321853 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 12:27:50.321853 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 12:27:50.321853 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:50.321853 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 284/566] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:27:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:50.321853 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a914ae5-6ece-4912-be21-17c703f550c5 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:50.323187 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:50.424395 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c5977-984b-4092-a8f8-92bd3b59715f None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:50.439983 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a914ae5-6ece-4912-be21-17c703f550c5 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:50.462108 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ff998-3c43-4c82-8f81-577a73771bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:50.462774 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ff998-3c43-4c82-8f81-577a73771bce None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:50.463033 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ff998-3c43-4c82-8f81-577a73771bce None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:50.463312 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ff998-3c43-4c82-8f81-577a73771bce None admin] PATH_INFO: `/v3/projects/service` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:50.470582 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ff998-3c43-4c82-8f81-577a73771bce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:50.472021 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ff998-3c43-4c82-8f81-577a73771bce None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:50.476250 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b73350-9513-45db-a61e-15460e91924a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:50.476909 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b73350-9513-45db-a61e-15460e91924a None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:50.477197 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b73350-9513-45db-a61e-15460e91924a None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:50.477480 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b73350-9513-45db-a61e-15460e91924a None admin] PATH_INFO: `/v3/domains` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:50.478359 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b73350-9513-45db-a61e-15460e91924a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:50.478669 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b73350-9513-45db-a61e-15460e91924a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:50.480047 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b73350-9513-45db-a61e-15460e91924a None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:50.483474 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-519ff998-3c43-4c82-8f81-577a73771bce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 12:27:50.483474 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:50.483474 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:50.483474 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:50.483474 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:50.483474 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:50.483474 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:50.483474 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:50.483474 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:50.483474 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:50.483474 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:50.483474 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:50.483474 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 12:27:50.483474 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 12:27:50.483474 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 12:27:50.484357 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 12:27:50.484357 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:50.484357 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:50.484357 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:50.484357 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:50.484357 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:50.484357 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:50.484357 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:50.484357 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:50.484357 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:50.484357 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:50.484357 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:50.484357 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:50.484357 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:50.484357 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:50.484357 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:50.484357 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:50.485297 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 12:27:50.485297 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 12:27:50.485297 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 12:27:50.485297 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 12:27:50.485297 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 12:27:50.485297 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 12:27:50.485297 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 12:27:50.485297 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:50.489588 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 283/567] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jul 27 12:27:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:50.490365 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ff998-3c43-4c82-8f81-577a73771bce None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:50.496933 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 285/568] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:50.496933 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b73350-9513-45db-a61e-15460e91924a None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:50.552493 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:50.566541 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:50.608584 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ff998-3c43-4c82-8f81-577a73771bce None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:50.612123 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b73350-9513-45db-a61e-15460e91924a None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:50.654843 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05cfc7d-9b73-44d0-a9a5-dae6a8f08326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:50.655742 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05cfc7d-9b73-44d0-a9a5-dae6a8f08326 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:50.656027 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05cfc7d-9b73-44d0-a9a5-dae6a8f08326 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:50.656306 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05cfc7d-9b73-44d0-a9a5-dae6a8f08326 None admin] PATH_INFO: `/v3/users` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:50.657922 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05cfc7d-9b73-44d0-a9a5-dae6a8f08326 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:50.658232 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05cfc7d-9b73-44d0-a9a5-dae6a8f08326 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:50.659972 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05cfc7d-9b73-44d0-a9a5-dae6a8f08326 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:50.667444 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d8aad-7bb2-4eae-bdee-c9f2045f0350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:50.668131 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d8aad-7bb2-4eae-bdee-c9f2045f0350 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:50.668416 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d8aad-7bb2-4eae-bdee-c9f2045f0350 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:50.668695 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d8aad-7bb2-4eae-bdee-c9f2045f0350 None admin] PATH_INFO: `/v3/projects` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:50.669459 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d8aad-7bb2-4eae-bdee-c9f2045f0350 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:50.669970 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d8aad-7bb2-4eae-bdee-c9f2045f0350 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:50.672216 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d8aad-7bb2-4eae-bdee-c9f2045f0350 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:50.679058 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 284/569] 10.222.0.55 () {56 vars in 1137 bytes} [Wed Jul 27 12:27:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:50.679849 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05cfc7d-9b73-44d0-a9a5-dae6a8f08326 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:50.686081 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 286/570] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jul 27 12:27:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:50.686937 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d8aad-7bb2-4eae-bdee-c9f2045f0350 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:50.798185 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d8aad-7bb2-4eae-bdee-c9f2045f0350 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:50.812899 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:50.814594 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05cfc7d-9b73-44d0-a9a5-dae6a8f08326 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:50.837314 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf5aa9-a0e0-45d6-87b4-dbc1fdc63ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:50.838076 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf5aa9-a0e0-45d6-87b4-dbc1fdc63ffd None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:50.838276 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf5aa9-a0e0-45d6-87b4-dbc1fdc63ffd None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:50.838553 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf5aa9-a0e0-45d6-87b4-dbc1fdc63ffd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:50.842369 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:50.850462 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf5aa9-a0e0-45d6-87b4-dbc1fdc63ffd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:50.851960 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf5aa9-a0e0-45d6-87b4-dbc1fdc63ffd None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:50.852248 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61600b0-98c7-43e2-a23c-0188ce876a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:50.852885 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61600b0-98c7-43e2-a23c-0188ce876a28 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:50.853168 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61600b0-98c7-43e2-a23c-0188ce876a28 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:50.853442 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61600b0-98c7-43e2-a23c-0188ce876a28 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:50.860760 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61600b0-98c7-43e2-a23c-0188ce876a28 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:50.862219 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61600b0-98c7-43e2-a23c-0188ce876a28 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:50.867028 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-a0bf5aa9-a0e0-45d6-87b4-dbc1fdc63ffd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:50.867028 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:50.867028 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:50.867028 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:50.867028 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:50.867028 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:50.867028 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:50.867028 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:50.867028 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:50.867028 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:50.867028 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:50.867028 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:50.867028 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:27:50.867028 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:27:50.867028 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:27:50.867986 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:27:50.867986 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:50.867986 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:50.867986 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:50.867986 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:50.867986 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:50.867986 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:50.867986 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:50.867986 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:50.867986 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:50.867986 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:50.867986 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:50.867986 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:50.867986 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:50.867986 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:50.867986 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:50.867986 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:50.868874 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:27:50.868874 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:27:50.868874 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:50.868874 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:50.872722 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 287/571] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:27:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:50.873525 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf5aa9-a0e0-45d6-87b4-dbc1fdc63ffd None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:50.875002 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-b61600b0-98c7-43e2-a23c-0188ce876a28 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 12:27:50.875002 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:50.875002 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:50.875002 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:50.875002 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:50.875002 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:50.875002 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:50.875002 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:50.875002 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:50.875002 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:50.875002 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:50.875002 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:50.875002 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 12:27:50.875002 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 12:27:50.875002 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 12:27:50.875002 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 12:27:50.875948 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:50.875948 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:50.875948 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 12:27:50.875948 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:27:50.875948 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 12:27:50.875948 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:27:50.875948 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:50.875948 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:50.875948 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:50.875948 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:50.875948 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:50.875948 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:50.875948 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:50.875948 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:50.875948 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:50.875948 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:50.875948 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:50.875948 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:50.876885 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:50.876885 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:50.876885 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 12:27:50.876885 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 12:27:50.876885 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 12:27:50.876885 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 12:27:50.876885 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 12:27:50.876885 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 12:27:50.876885 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 12:27:50.876885 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:50.876885 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 285/572] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jul 27 12:27:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:50.879807 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61600b0-98c7-43e2-a23c-0188ce876a28 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:50.986375 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf5aa9-a0e0-45d6-87b4-dbc1fdc63ffd None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:50.993129 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61600b0-98c7-43e2-a23c-0188ce876a28 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:51.022245 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241deba-79d8-4fae-92aa-721c8f6845f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:51.022907 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241deba-79d8-4fae-92aa-721c8f6845f9 None admin] REQUEST_METHOD: `PUT` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:51.023187 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241deba-79d8-4fae-92aa-721c8f6845f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:51.023464 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241deba-79d8-4fae-92aa-721c8f6845f9 None admin] PATH_INFO: `/v3/projects/e3316e9a169444ac827619608acc9fb7/users/a436eb33e8b040d192f1cfc9771fd351/roles/ec09bb8ea1664640a975563cc41cc39b` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:51.032639 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c070ac-b723-4436-abcc-40ed059dbc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:51.033627 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c070ac-b723-4436-abcc-40ed059dbc2a None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:51.034146 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c070ac-b723-4436-abcc-40ed059dbc2a None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:51.034607 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c070ac-b723-4436-abcc-40ed059dbc2a None admin] PATH_INFO: `/v3/domains` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:51.035494 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c070ac-b723-4436-abcc-40ed059dbc2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:51.035967 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c070ac-b723-4436-abcc-40ed059dbc2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:51.037484 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c070ac-b723-4436-abcc-40ed059dbc2a None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:51.039155 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7241deba-79d8-4fae-92aa-721c8f6845f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3316e9a169444ac827619608acc9fb7, user_id=a436eb33e8b040d192f1cfc9771fd351, role_id=ec09bb8ea1664640a975563cc41cc39b)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:51.040578 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7241deba-79d8-4fae-92aa-721c8f6845f9 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:51.054180 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 288/573] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jul 27 12:27:50 2022] PUT /identity/v3/projects/e3316e9a169444ac827619608acc9fb7/users/a436eb33e8b040d192f1cfc9771fd351/roles/ec09bb8ea1664640a975563cc41cc39b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 12:27:51.055194 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241deba-79d8-4fae-92aa-721c8f6845f9 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:51.056784 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 286/574] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:51.067003 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c070ac-b723-4436-abcc-40ed059dbc2a None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:51.081252 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:51.124521 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:51.185066 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c070ac-b723-4436-abcc-40ed059dbc2a None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:51.190637 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241deba-79d8-4fae-92aa-721c8f6845f9 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:51.230102 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c7a97-4fd1-49e4-8ab0-4a3df5b525d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:51.231172 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c7a97-4fd1-49e4-8ab0-4a3df5b525d5 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:51.232013 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c7a97-4fd1-49e4-8ab0-4a3df5b525d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:51.232398 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c7a97-4fd1-49e4-8ab0-4a3df5b525d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:51.237501 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ef063-3e0e-4add-9d83-afecc6793eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:51.238412 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ef063-3e0e-4add-9d83-afecc6793eed None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:51.238856 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ef063-3e0e-4add-9d83-afecc6793eed None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:51.239291 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ef063-3e0e-4add-9d83-afecc6793eed None admin] PATH_INFO: `/v3/users` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:51.240315 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ef063-3e0e-4add-9d83-afecc6793eed None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:51.240778 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ef063-3e0e-4add-9d83-afecc6793eed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:51.241572 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99c7a97-4fd1-49e4-8ab0-4a3df5b525d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:51.242934 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ef063-3e0e-4add-9d83-afecc6793eed None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:51.243258 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99c7a97-4fd1-49e4-8ab0-4a3df5b525d5 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:51.260739 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-a99c7a97-4fd1-49e4-8ab0-4a3df5b525d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 12:27:51.260739 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:51.260739 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:51.260739 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:51.260739 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:51.260739 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:51.260739 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:51.260739 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:51.260739 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:51.260739 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:51.260739 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:51.260739 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:51.260739 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 12:27:51.260739 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 12:27:51.260739 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 12:27:51.261741 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 12:27:51.261741 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:51.261741 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:51.261741 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:51.261741 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:51.261741 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:51.261741 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:51.261741 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:51.261741 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:51.261741 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:51.261741 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:51.261741 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:51.261741 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:51.261741 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:51.261741 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:51.261741 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:51.261741 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:51.262652 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 12:27:51.262652 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 12:27:51.262652 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 12:27:51.262652 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 12:27:51.262652 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 12:27:51.262652 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 12:27:51.262652 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 12:27:51.262652 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:51.262652 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 287/575] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jul 27 12:27:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 12:27:51.268504 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c7a97-4fd1-49e4-8ab0-4a3df5b525d5 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:51.268679 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 289/576] 10.222.0.55 () {56 vars in 1139 bytes} [Wed Jul 27 12:27:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:51.274300 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ef063-3e0e-4add-9d83-afecc6793eed None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:51.358027 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:51.381637 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ef063-3e0e-4add-9d83-afecc6793eed None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:51.399764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c7a97-4fd1-49e4-8ab0-4a3df5b525d5 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:51.409248 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:51.425420 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f14de-0055-42f3-ab6c-309fd08e3878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:51.426702 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f14de-0055-42f3-ab6c-309fd08e3878 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:51.427642 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f14de-0055-42f3-ab6c-309fd08e3878 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:51.428383 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f14de-0055-42f3-ab6c-309fd08e3878 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:51.438193 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4c09e-b43e-4805-8d47-5f3ee8d00837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:51.438816 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4c09e-b43e-4805-8d47-5f3ee8d00837 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:51.439096 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4c09e-b43e-4805-8d47-5f3ee8d00837 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:51.439368 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4c09e-b43e-4805-8d47-5f3ee8d00837 None admin] PATH_INFO: `/v3/projects` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:51.440125 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4c09e-b43e-4805-8d47-5f3ee8d00837 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:51.440428 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4c09e-b43e-4805-8d47-5f3ee8d00837 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:51.441863 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4c09e-b43e-4805-8d47-5f3ee8d00837 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:51.443710 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f14de-0055-42f3-ab6c-309fd08e3878 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:51.445851 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f14de-0055-42f3-ab6c-309fd08e3878 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:51.459491 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 288/577] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jul 27 12:27:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:27:51.460919 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4c09e-b43e-4805-8d47-5f3ee8d00837 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:51.465371 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-bf2f14de-0055-42f3-ab6c-309fd08e3878 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:51.465371 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:51.465371 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:51.465371 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:51.465371 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:51.465371 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:51.465371 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:51.465371 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:51.465371 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:51.465371 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:51.465371 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:51.465371 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:51.465371 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:27:51.465371 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:27:51.465371 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:27:51.466306 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:27:51.466306 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:51.466306 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:51.466306 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:51.466306 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:51.466306 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:51.466306 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:51.466306 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:51.466306 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:51.466306 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:51.466306 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:51.466306 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:51.466306 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:51.466306 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:51.466306 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:51.466306 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:51.466306 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:51.467223 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:27:51.467223 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:27:51.467223 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:51.467223 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:51.469410 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 290/578] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:27:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 12:27:51.475119 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f14de-0055-42f3-ab6c-309fd08e3878 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:51.577534 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4c09e-b43e-4805-8d47-5f3ee8d00837 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:51.600882 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f14de-0055-42f3-ab6c-309fd08e3878 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:51.616648 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23954e1e-c2de-4d45-853a-d92feab2b8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:51.617450 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23954e1e-c2de-4d45-853a-d92feab2b8b9 None admin] REQUEST_METHOD: `PUT` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:51.617788 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23954e1e-c2de-4d45-853a-d92feab2b8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:51.618058 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23954e1e-c2de-4d45-853a-d92feab2b8b9 None admin] PATH_INFO: `/v3/projects/e3316e9a169444ac827619608acc9fb7/users/e6ead01964e14f389bcfca4e9d9b6475/roles/ec09bb8ea1664640a975563cc41cc39b` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:51.635060 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23954e1e-c2de-4d45-853a-d92feab2b8b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3316e9a169444ac827619608acc9fb7, user_id=e6ead01964e14f389bcfca4e9d9b6475, role_id=ec09bb8ea1664640a975563cc41cc39b)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:51.635422 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:51.636913 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23954e1e-c2de-4d45-853a-d92feab2b8b9 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:51.655059 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ae202-5623-489f-954a-2e756bf5ab8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:51.655635 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 289/579] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jul 27 12:27:51 2022] PUT /identity/v3/projects/e3316e9a169444ac827619608acc9fb7/users/e6ead01964e14f389bcfca4e9d9b6475/roles/ec09bb8ea1664640a975563cc41cc39b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 12:27:51.657793 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ae202-5623-489f-954a-2e756bf5ab8e None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:51.658341 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ae202-5623-489f-954a-2e756bf5ab8e None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:51.658852 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ae202-5623-489f-954a-2e756bf5ab8e None admin] PATH_INFO: `/v3/domains` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:51.659877 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ae202-5623-489f-954a-2e756bf5ab8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:51.660438 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ae202-5623-489f-954a-2e756bf5ab8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:51.662188 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ae202-5623-489f-954a-2e756bf5ab8e None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:51.679989 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 291/580] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:27:51.691961 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23954e1e-c2de-4d45-853a-d92feab2b8b9 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:51.718047 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:51.807711 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23954e1e-c2de-4d45-853a-d92feab2b8b9 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:51.843955 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64193d1-4d6d-4d08-9ea0-f401581d26a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:51.845072 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64193d1-4d6d-4d08-9ea0-f401581d26a5 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:51.845360 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64193d1-4d6d-4d08-9ea0-f401581d26a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:51.845668 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64193d1-4d6d-4d08-9ea0-f401581d26a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:51.853439 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64193d1-4d6d-4d08-9ea0-f401581d26a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:51.854941 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64193d1-4d6d-4d08-9ea0-f401581d26a5 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:51.868498 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-c64193d1-4d6d-4d08-9ea0-f401581d26a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 12:27:51.868498 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:51.868498 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:51.868498 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:51.868498 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:51.868498 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:51.868498 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:51.868498 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:51.868498 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:51.868498 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:51.868498 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:51.868498 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:51.868498 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 12:27:51.868498 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 12:27:51.868498 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 12:27:51.869635 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 12:27:51.869635 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:51.869635 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:51.869635 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:51.869635 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:51.869635 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:51.869635 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:51.869635 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:51.869635 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:51.869635 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:51.869635 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:51.869635 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:51.869635 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:51.869635 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:51.869635 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:51.869635 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:51.869635 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:51.870801 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 12:27:51.870801 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 12:27:51.870801 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 12:27:51.870801 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 12:27:51.870801 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 12:27:51.870801 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 12:27:51.870801 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 12:27:51.870801 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:51.870801 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 290/581] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jul 27 12:27:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:51.876101 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ae202-5623-489f-954a-2e756bf5ab8e None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:51.981685 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ae202-5623-489f-954a-2e756bf5ab8e None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:52.016756 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399b733-49c7-428d-be5e-eb2e40d8bba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:52.017546 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399b733-49c7-428d-be5e-eb2e40d8bba9 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:52.017967 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399b733-49c7-428d-be5e-eb2e40d8bba9 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:52.018442 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399b733-49c7-428d-be5e-eb2e40d8bba9 None admin] PATH_INFO: `/v3/projects` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:52.019305 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9399b733-49c7-428d-be5e-eb2e40d8bba9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:52.019724 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9399b733-49c7-428d-be5e-eb2e40d8bba9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:52.021265 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9399b733-49c7-428d-be5e-eb2e40d8bba9 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:52.036861 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 292/582] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jul 27 12:27:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:52.042180 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64193d1-4d6d-4d08-9ea0-f401581d26a5 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:52.123944 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:52.148914 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64193d1-4d6d-4d08-9ea0-f401581d26a5 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:52.184390 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f16391-4c79-41e7-ab3a-c944f8fc2e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:52.185227 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f16391-4c79-41e7-ab3a-c944f8fc2e62 None admin] REQUEST_METHOD: `PUT` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:52.185623 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f16391-4c79-41e7-ab3a-c944f8fc2e62 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:52.186019 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f16391-4c79-41e7-ab3a-c944f8fc2e62 None admin] PATH_INFO: `/v3/projects/e3316e9a169444ac827619608acc9fb7/users/645587202a91426c98f86abdcddce8cd/roles/ec09bb8ea1664640a975563cc41cc39b` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:52.201794 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f16391-4c79-41e7-ab3a-c944f8fc2e62 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3316e9a169444ac827619608acc9fb7, user_id=645587202a91426c98f86abdcddce8cd, role_id=ec09bb8ea1664640a975563cc41cc39b)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:52.203385 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f16391-4c79-41e7-ab3a-c944f8fc2e62 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:52.219827 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 291/583] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jul 27 12:27:52 2022] PUT /identity/v3/projects/e3316e9a169444ac827619608acc9fb7/users/645587202a91426c98f86abdcddce8cd/roles/ec09bb8ea1664640a975563cc41cc39b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 12:27:52.490338 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a1634-2bd3-4372-bda5-4fe79fd75cdb None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:52.490705 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a1634-2bd3-4372-bda5-4fe79fd75cdb None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:52.490822 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a1634-2bd3-4372-bda5-4fe79fd75cdb None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:52.492665 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 293/584] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:52.497892 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b3e0c-3e25-48f6-81d1-5d418fa3fd40 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:52.498218 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b3e0c-3e25-48f6-81d1-5d418fa3fd40 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:52.498502 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b3e0c-3e25-48f6-81d1-5d418fa3fd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:52.518358 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-655b3e0c-3e25-48f6-81d1-5d418fa3fd40 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:52.519578 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-655b3e0c-3e25-48f6-81d1-5d418fa3fd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:52.587471 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 292/585] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:27:52.611727 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a1634-2bd3-4372-bda5-4fe79fd75cdb None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:52.662529 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:52.724600 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a1634-2bd3-4372-bda5-4fe79fd75cdb None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:52.760065 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ba4f2-faba-4418-ba57-e6e958e10874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:52.760627 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ba4f2-faba-4418-ba57-e6e958e10874 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:52.760909 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ba4f2-faba-4418-ba57-e6e958e10874 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:52.761185 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ba4f2-faba-4418-ba57-e6e958e10874 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:52.772603 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ba4f2-faba-4418-ba57-e6e958e10874 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:52.777548 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-764ba4f2-faba-4418-ba57-e6e958e10874 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 12:27:52.777548 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:52.777548 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:52.777548 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:52.777548 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:52.777548 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:52.777548 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:52.777548 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:52.777548 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:52.777548 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:52.777548 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:52.777548 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:52.777548 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:52.777548 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:52.777548 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:52.777548 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:52.778536 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:52.778536 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:52.778536 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:52.778536 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:52.778536 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:52.778536 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:52.778536 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:52.778536 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:52.778536 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:52.778536 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:52.778536 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:52.778536 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:52.778536 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:52.778536 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:52.778536 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:52.778536 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:52.779404 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:52.779404 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:52.779404 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:52.779404 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:52.779404 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:52.779404 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:52.779404 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:52.779404 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:52.779404 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:52.779404 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:52.779404 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 12:27:52.779404 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:52.779404 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 294/586] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jul 27 12:27:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:52.784729 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b3e0c-3e25-48f6-81d1-5d418fa3fd40 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:52.848101 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:52.893655 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b3e0c-3e25-48f6-81d1-5d418fa3fd40 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:52.932279 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364d75a-5f70-40cd-b527-a59fd006d741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:52.932919 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364d75a-5f70-40cd-b527-a59fd006d741 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:52.933206 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364d75a-5f70-40cd-b527-a59fd006d741 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:52.933490 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364d75a-5f70-40cd-b527-a59fd006d741 None admin] PATH_INFO: `/v3/roles` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:52.934247 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364d75a-5f70-40cd-b527-a59fd006d741 None admin] RBAC: Adding query filter params (name=service) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:52.934556 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364d75a-5f70-40cd-b527-a59fd006d741 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:52.935930 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364d75a-5f70-40cd-b527-a59fd006d741 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:52.945572 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 293/587] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jul 27 12:27:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:27:52.950768 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ba4f2-faba-4418-ba57-e6e958e10874 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:53.074789 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ba4f2-faba-4418-ba57-e6e958e10874 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:53.077417 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:53.110297 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c3e13b-e3d7-4dd5-9d51-bc446b401562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:53.110953 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3e13b-e3d7-4dd5-9d51-bc446b401562 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:53.111232 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3e13b-e3d7-4dd5-9d51-bc446b401562 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:53.111503 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3e13b-e3d7-4dd5-9d51-bc446b401562 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:53.122791 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c3e13b-e3d7-4dd5-9d51-bc446b401562 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:53.124256 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c3e13b-e3d7-4dd5-9d51-bc446b401562 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:53.138583 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-66c3e13b-e3d7-4dd5-9d51-bc446b401562 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:53.138583 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:53.138583 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:53.138583 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:53.138583 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:53.138583 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:53.138583 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:53.138583 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:53.138583 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:53.138583 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:53.138583 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:53.138583 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:53.138583 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:27:53.138583 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:27:53.138583 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:27:53.139489 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:27:53.139489 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:53.139489 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:53.139489 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:53.139489 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:53.139489 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:53.139489 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:53.139489 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:53.139489 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:53.139489 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:53.139489 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:53.139489 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:53.139489 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:53.139489 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:53.139489 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:53.139489 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:53.139489 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:53.140397 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:27:53.140397 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:27:53.140397 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:53.140397 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:53.140397 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 295/588] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:27:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:53.146966 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364d75a-5f70-40cd-b527-a59fd006d741 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:53.255965 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364d75a-5f70-40cd-b527-a59fd006d741 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:53.275161 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:53.292754 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cde50e-133c-4578-bb39-eb079bd785e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:53.293372 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cde50e-133c-4578-bb39-eb079bd785e5 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:53.293689 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cde50e-133c-4578-bb39-eb079bd785e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:53.293970 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cde50e-133c-4578-bb39-eb079bd785e5 None admin] PATH_INFO: `/v3/domains` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:53.294667 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cde50e-133c-4578-bb39-eb079bd785e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:53.294978 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cde50e-133c-4578-bb39-eb079bd785e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:53.296332 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cde50e-133c-4578-bb39-eb079bd785e5 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:53.309142 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 294/589] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:27:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:53.315083 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c3e13b-e3d7-4dd5-9d51-bc446b401562 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:53.400780 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e42569-d6d1-4d20-b9df-1037ef9d24be None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:53.400973 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e42569-d6d1-4d20-b9df-1037ef9d24be None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:53.401252 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e42569-d6d1-4d20-b9df-1037ef9d24be None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:53.402879 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 295/590] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:53.410654 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266b7d4-5444-4f5c-8164-f18ad5b93812 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:53.411176 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266b7d4-5444-4f5c-8164-f18ad5b93812 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:53.411693 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266b7d4-5444-4f5c-8164-f18ad5b93812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:53.430062 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c3e13b-e3d7-4dd5-9d51-bc446b401562 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:53.431570 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-3266b7d4-5444-4f5c-8164-f18ad5b93812 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:53.433069 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-3266b7d4-5444-4f5c-8164-f18ad5b93812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:53.472320 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b166acb-c0ea-4d6f-bf2a-02b098cec3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:53.473762 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b166acb-c0ea-4d6f-bf2a-02b098cec3e5 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:53.475954 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b166acb-c0ea-4d6f-bf2a-02b098cec3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:53.476459 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b166acb-c0ea-4d6f-bf2a-02b098cec3e5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:53.488805 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b166acb-c0ea-4d6f-bf2a-02b098cec3e5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:53.490504 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b166acb-c0ea-4d6f-bf2a-02b098cec3e5 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:53.507385 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-2b166acb-c0ea-4d6f-bf2a-02b098cec3e5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 12:27:53.507385 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:53.507385 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:53.507385 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:53.507385 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:53.507385 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:53.507385 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:53.507385 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:53.507385 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:53.507385 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:53.507385 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:53.507385 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:53.507385 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 12:27:53.507385 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 12:27:53.507385 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 12:27:53.507385 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 12:27:53.508396 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:53.508396 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:53.508396 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 12:27:53.508396 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:27:53.508396 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 12:27:53.508396 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:27:53.508396 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:53.508396 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:53.508396 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:53.508396 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:53.508396 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:53.508396 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:53.508396 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:53.508396 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:53.508396 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:53.508396 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:53.508396 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:53.508396 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:53.509428 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:53.509428 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:53.509428 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 12:27:53.509428 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 12:27:53.509428 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 12:27:53.509428 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 12:27:53.509428 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 12:27:53.509428 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 12:27:53.509428 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 12:27:53.509428 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:53.509428 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 296/591] 10.222.0.55 () {56 vars in 1093 bytes} [Wed Jul 27 12:27:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:53.517095 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b166acb-c0ea-4d6f-bf2a-02b098cec3e5 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:53.529694 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 296/592] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 12:27:53.538574 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:53.544631 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266b7d4-5444-4f5c-8164-f18ad5b93812 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:53.637561 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b166acb-c0ea-4d6f-bf2a-02b098cec3e5 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:53.647797 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266b7d4-5444-4f5c-8164-f18ad5b93812 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:53.659344 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:53.682183 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdba0c7-812a-4243-9518-ee999e5a9a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:53.683612 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdba0c7-812a-4243-9518-ee999e5a9a63 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:53.684133 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdba0c7-812a-4243-9518-ee999e5a9a63 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:53.684671 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdba0c7-812a-4243-9518-ee999e5a9a63 None admin] PATH_INFO: `/v3/users` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:53.685710 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdba0c7-812a-4243-9518-ee999e5a9a63 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:53.686228 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdba0c7-812a-4243-9518-ee999e5a9a63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:53.689174 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdba0c7-812a-4243-9518-ee999e5a9a63 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:53.695045 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88893f2-1c80-45fc-8819-78ead1e47c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:53.695703 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88893f2-1c80-45fc-8819-78ead1e47c1d None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:53.695990 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88893f2-1c80-45fc-8819-78ead1e47c1d None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:53.696269 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88893f2-1c80-45fc-8819-78ead1e47c1d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:53.708188 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88893f2-1c80-45fc-8819-78ead1e47c1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:53.716408 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-c88893f2-1c80-45fc-8819-78ead1e47c1d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 12:27:53.716408 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:53.716408 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:53.716408 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:53.716408 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:53.716408 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:53.716408 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:53.716408 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:53.716408 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:53.716408 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:53.716408 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:53.716408 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:53.716408 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:53.716408 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:53.716408 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:53.716408 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:53.717369 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:53.717369 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:53.717369 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:53.717369 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:53.717369 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:53.717369 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:53.717369 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:53.717369 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:53.717369 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:53.717369 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:53.717369 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:53.717369 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:53.717369 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:53.717369 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:53.717369 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:53.717369 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:53.718239 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:53.718239 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:53.718239 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:53.718239 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:53.718239 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:53.718239 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:53.718239 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:53.718239 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:53.718239 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:53.718239 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:53.718239 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 12:27:53.718239 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:53.718877 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 297/594] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jul 27 12:27:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:53.719771 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 297/594] 10.222.0.55 () {56 vars in 1133 bytes} [Wed Jul 27 12:27:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:27:53.721032 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88893f2-1c80-45fc-8819-78ead1e47c1d None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:53.721293 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdba0c7-812a-4243-9518-ee999e5a9a63 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:53.810420 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:53.837253 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88893f2-1c80-45fc-8819-78ead1e47c1d None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:53.842196 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdba0c7-812a-4243-9518-ee999e5a9a63 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:53.872381 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3780a6f-455a-4f5b-91bd-f45b5cb4794b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:53.873074 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3780a6f-455a-4f5b-91bd-f45b5cb4794b None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:53.873276 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3780a6f-455a-4f5b-91bd-f45b5cb4794b None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:53.873557 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3780a6f-455a-4f5b-91bd-f45b5cb4794b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:53.882264 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf34a95-60a8-407d-b91d-d4b0fc95c80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:53.883270 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf34a95-60a8-407d-b91d-d4b0fc95c80b None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:53.883760 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf34a95-60a8-407d-b91d-d4b0fc95c80b None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:53.884244 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf34a95-60a8-407d-b91d-d4b0fc95c80b None admin] PATH_INFO: `/v3/roles` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:53.885279 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf34a95-60a8-407d-b91d-d4b0fc95c80b None admin] RBAC: Adding query filter params (name=service) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:53.885825 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf34a95-60a8-407d-b91d-d4b0fc95c80b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:53.888218 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf34a95-60a8-407d-b91d-d4b0fc95c80b None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:53.897996 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 298/595] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jul 27 12:27:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:53.903755 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf34a95-60a8-407d-b91d-d4b0fc95c80b None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:53.916191 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:53.965948 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3780a6f-455a-4f5b-91bd-f45b5cb4794b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:53.968097 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3780a6f-455a-4f5b-91bd-f45b5cb4794b None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:54.038386 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf34a95-60a8-407d-b91d-d4b0fc95c80b None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:54.077310 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55072f71-19fa-4cdf-ab05-9dab17efbfb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:54.078271 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55072f71-19fa-4cdf-ab05-9dab17efbfb6 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:54.078789 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55072f71-19fa-4cdf-ab05-9dab17efbfb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:54.079079 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55072f71-19fa-4cdf-ab05-9dab17efbfb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:54.082401 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:54.092680 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55072f71-19fa-4cdf-ab05-9dab17efbfb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:54.094975 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55072f71-19fa-4cdf-ab05-9dab17efbfb6 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:54.110705 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-55072f71-19fa-4cdf-ab05-9dab17efbfb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:54.110705 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:54.110705 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:54.110705 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:54.110705 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:54.110705 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:54.110705 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:54.110705 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:54.110705 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:54.110705 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:54.110705 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:54.110705 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:54.110705 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:27:54.110705 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:27:54.110705 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:27:54.111851 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:27:54.111851 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:54.111851 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:54.111851 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:54.111851 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:54.111851 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:54.111851 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:54.111851 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:54.111851 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:54.111851 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:54.111851 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:54.111851 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:54.111851 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:54.111851 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:54.111851 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:54.111851 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:54.111851 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:54.113003 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:27:54.113003 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:27:54.113003 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:54.113003 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:54.113327 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 298/596] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jul 27 12:27:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 12:27:54.114392 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3780a6f-455a-4f5b-91bd-f45b5cb4794b None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:54.117758 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 299/597] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:27:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:54.120302 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55072f71-19fa-4cdf-ab05-9dab17efbfb6 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:54.192875 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:54.227376 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3780a6f-455a-4f5b-91bd-f45b5cb4794b None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:54.229873 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55072f71-19fa-4cdf-ab05-9dab17efbfb6 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:54.262539 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c3ed1-c8b4-4dec-a829-2a4456694f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:54.263176 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c3ed1-c8b4-4dec-a829-2a4456694f4e None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:54.263460 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c3ed1-c8b4-4dec-a829-2a4456694f4e None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:54.263735 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c3ed1-c8b4-4dec-a829-2a4456694f4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:54.267062 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39bf426-be41-490f-9c17-e557782d000a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:54.267782 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39bf426-be41-490f-9c17-e557782d000a None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:54.268165 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39bf426-be41-490f-9c17-e557782d000a None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:54.268561 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39bf426-be41-490f-9c17-e557782d000a None admin] PATH_INFO: `/v3/domains` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:54.269356 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39bf426-be41-490f-9c17-e557782d000a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:54.269844 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39bf426-be41-490f-9c17-e557782d000a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:54.271631 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39bf426-be41-490f-9c17-e557782d000a None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:54.274468 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04c3ed1-c8b4-4dec-a829-2a4456694f4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:54.275883 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04c3ed1-c8b4-4dec-a829-2a4456694f4e None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:54.287018 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 300/598] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:27:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:54.287424 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d858df-a5eb-407c-8e73-1f6015d1ab63 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:54.287842 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d858df-a5eb-407c-8e73-1f6015d1ab63 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:54.288273 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d858df-a5eb-407c-8e73-1f6015d1ab63 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:54.289996 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 301/599] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:54.290825 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d858df-a5eb-407c-8e73-1f6015d1ab63 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:54.291587 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-d04c3ed1-c8b4-4dec-a829-2a4456694f4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:54.291587 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:54.291587 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:54.291587 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:54.291587 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:54.291587 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:54.291587 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:54.291587 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:54.291587 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:54.291587 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:54.291587 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:54.291587 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:54.291587 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:27:54.291587 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:27:54.291587 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:27:54.292462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:27:54.292462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:54.292462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:54.292462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:54.292462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:54.292462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:54.292462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:54.292462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:54.292462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:54.292462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:54.292462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:54.292462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:54.292462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:54.292462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:54.292462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:54.292462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:54.292462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:54.293369 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:27:54.293369 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:27:54.293369 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:54.293369 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:54.297629 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 299/600] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:27:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:54.299803 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c9eec-0905-4b1e-87b1-af37e9bb1854 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:54.300097 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c9eec-0905-4b1e-87b1-af37e9bb1854 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:54.300381 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c9eec-0905-4b1e-87b1-af37e9bb1854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:54.322271 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-9a9c9eec-0905-4b1e-87b1-af37e9bb1854 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:54.323753 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-9a9c9eec-0905-4b1e-87b1-af37e9bb1854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:54.346872 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:54.401848 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 300/601] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:27:54.405931 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c9eec-0905-4b1e-87b1-af37e9bb1854 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:54.411738 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d858df-a5eb-407c-8e73-1f6015d1ab63 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:54.453017 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb300e64-bb95-44d1-b052-f3be4d4451be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:54.453808 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb300e64-bb95-44d1-b052-f3be4d4451be None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:54.454167 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb300e64-bb95-44d1-b052-f3be4d4451be None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:54.454518 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb300e64-bb95-44d1-b052-f3be4d4451be None admin] PATH_INFO: `/v3/users/glance` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:54.462859 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb300e64-bb95-44d1-b052-f3be4d4451be None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:54.464439 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb300e64-bb95-44d1-b052-f3be4d4451be None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:54.469152 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:54.477108 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-fb300e64-bb95-44d1-b052-f3be4d4451be None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 12:27:54.477108 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:54.477108 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:54.477108 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:54.477108 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:54.477108 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:54.477108 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:54.477108 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:54.477108 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:54.477108 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:54.477108 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:54.477108 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:54.477108 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 12:27:54.477108 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 12:27:54.477108 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 12:27:54.477108 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 12:27:54.478294 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:54.478294 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:54.478294 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 12:27:54.478294 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:27:54.478294 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 12:27:54.478294 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:27:54.478294 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:54.478294 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:54.478294 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:54.478294 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:54.478294 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:54.478294 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:54.478294 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:54.478294 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:54.478294 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:54.478294 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:54.478294 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:54.478294 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:54.479482 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:54.479482 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:54.479482 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 12:27:54.479482 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 12:27:54.479482 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 12:27:54.479482 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 12:27:54.479482 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 12:27:54.479482 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 12:27:54.479482 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 12:27:54.479482 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:54.481742 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 302/602] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:27:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:54.483393 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb300e64-bb95-44d1-b052-f3be4d4451be None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:54.527579 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c9eec-0905-4b1e-87b1-af37e9bb1854 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:54.563991 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a51c43-18ad-46e2-8a34-fca4981a3713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:54.564610 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a51c43-18ad-46e2-8a34-fca4981a3713 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:54.564894 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a51c43-18ad-46e2-8a34-fca4981a3713 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:54.565170 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a51c43-18ad-46e2-8a34-fca4981a3713 None admin] PATH_INFO: `/v3/domains` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:54.565895 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a51c43-18ad-46e2-8a34-fca4981a3713 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:54.566206 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a51c43-18ad-46e2-8a34-fca4981a3713 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:54.567564 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a51c43-18ad-46e2-8a34-fca4981a3713 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:54.583826 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 301/603] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:27:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:54.583826 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a51c43-18ad-46e2-8a34-fca4981a3713 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:54.597225 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb300e64-bb95-44d1-b052-f3be4d4451be None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:54.606420 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:54.631845 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d4497-7c07-485a-9846-5955a3a813b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:54.632485 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d4497-7c07-485a-9846-5955a3a813b0 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:54.632769 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d4497-7c07-485a-9846-5955a3a813b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:54.633048 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d4497-7c07-485a-9846-5955a3a813b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:54.642940 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d4497-7c07-485a-9846-5955a3a813b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:54.648317 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-4c3d4497-7c07-485a-9846-5955a3a813b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 12:27:54.648317 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:54.648317 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:54.648317 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:54.648317 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:54.648317 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:54.648317 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:54.648317 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:54.648317 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:54.648317 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:54.648317 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:54.648317 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:54.648317 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:54.648317 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:54.648317 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:54.648317 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:54.649297 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:54.649297 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:54.649297 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:54.649297 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:54.649297 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:54.649297 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:54.649297 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:54.649297 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:54.649297 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:54.649297 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:54.649297 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:54.649297 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:54.649297 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:54.649297 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:54.649297 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:54.649297 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:54.650189 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:54.650189 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:54.650189 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:54.650189 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:54.650189 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:54.650189 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:54.650189 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:54.650189 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:54.650189 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:54.650189 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:54.650189 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 12:27:54.650189 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:54.650189 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 303/604] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jul 27 12:27:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:54.650886 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d4497-7c07-485a-9846-5955a3a813b0 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:54.692185 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a51c43-18ad-46e2-8a34-fca4981a3713 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:54.702395 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:54.725839 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19c9b4-ec41-48c3-909b-78544fef35b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:54.726380 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19c9b4-ec41-48c3-909b-78544fef35b8 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:54.726669 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19c9b4-ec41-48c3-909b-78544fef35b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:54.726942 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19c9b4-ec41-48c3-909b-78544fef35b8 None admin] PATH_INFO: `/v3/users` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:54.727728 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab19c9b4-ec41-48c3-909b-78544fef35b8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:54.728032 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab19c9b4-ec41-48c3-909b-78544fef35b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:54.729470 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab19c9b4-ec41-48c3-909b-78544fef35b8 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:54.747255 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 302/605] 10.222.0.55 () {56 vars in 1137 bytes} [Wed Jul 27 12:27:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:54.748550 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471ee6b-f215-4c10-b1a8-50c45747fa80 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:54.748843 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471ee6b-f215-4c10-b1a8-50c45747fa80 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:54.749120 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471ee6b-f215-4c10-b1a8-50c45747fa80 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:54.750382 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 303/606] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:27:54.753290 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471ee6b-f215-4c10-b1a8-50c45747fa80 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:54.754681 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d4497-7c07-485a-9846-5955a3a813b0 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:54.790104 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b777bad-e422-4078-b8ec-379d8969808e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:54.790758 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b777bad-e422-4078-b8ec-379d8969808e None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:54.791031 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b777bad-e422-4078-b8ec-379d8969808e None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:54.791327 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b777bad-e422-4078-b8ec-379d8969808e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:54.798717 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b777bad-e422-4078-b8ec-379d8969808e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:54.800229 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b777bad-e422-4078-b8ec-379d8969808e None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:54.811581 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-9b777bad-e422-4078-b8ec-379d8969808e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 12:27:54.811581 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:54.811581 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:54.811581 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:54.811581 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:54.811581 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:54.811581 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:54.811581 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:54.811581 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:54.811581 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:54.811581 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:54.811581 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:54.811581 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 12:27:54.811581 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 12:27:54.811581 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 12:27:54.812541 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 12:27:54.812541 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:54.812541 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:54.812541 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:54.812541 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:54.812541 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:54.812541 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:54.812541 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:54.812541 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:54.812541 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:54.812541 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:54.812541 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:54.812541 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:54.812541 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:54.812541 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:54.812541 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:54.812541 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:54.813466 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 12:27:54.813466 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 12:27:54.813466 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 12:27:54.813466 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 12:27:54.813466 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 12:27:54.813466 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 12:27:54.813466 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 12:27:54.813466 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:54.813466 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 304/607] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jul 27 12:27:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:54.814007 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b777bad-e422-4078-b8ec-379d8969808e None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:54.842976 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:54.857515 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471ee6b-f215-4c10-b1a8-50c45747fa80 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:54.892046 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0df78-da49-4514-8e41-1d5c3a621ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:54.892661 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0df78-da49-4514-8e41-1d5c3a621ae4 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:54.892944 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0df78-da49-4514-8e41-1d5c3a621ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:54.893217 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0df78-da49-4514-8e41-1d5c3a621ae4 None admin] PATH_INFO: `/v3/roles` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:54.893963 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0df78-da49-4514-8e41-1d5c3a621ae4 None admin] RBAC: Adding query filter params (name=service) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:54.894272 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0df78-da49-4514-8e41-1d5c3a621ae4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:54.895625 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0df78-da49-4514-8e41-1d5c3a621ae4 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:54.903615 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 304/608] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jul 27 12:27:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:54.905479 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0d380-5edc-4872-b7c6-330c3397288e None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:54.905818 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0d380-5edc-4872-b7c6-330c3397288e None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:54.906102 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0d380-5edc-4872-b7c6-330c3397288e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:54.915738 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b777bad-e422-4078-b8ec-379d8969808e None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:54.923810 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-08e0d380-5edc-4872-b7c6-330c3397288e None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:54.924984 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-08e0d380-5edc-4872-b7c6-330c3397288e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:54.948113 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:54.948814 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3cfa8-f706-4d27-993c-bd698b7c2bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:54.949437 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3cfa8-f706-4d27-993c-bd698b7c2bbb None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:54.949751 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3cfa8-f706-4d27-993c-bd698b7c2bbb None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:54.950034 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3cfa8-f706-4d27-993c-bd698b7c2bbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:54.990317 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 305/609] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:27:54.991419 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0d380-5edc-4872-b7c6-330c3397288e None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:55.021725 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a3cfa8-f706-4d27-993c-bd698b7c2bbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:55.023209 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a3cfa8-f706-4d27-993c-bd698b7c2bbb None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:55.048864 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:55.101037 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0d380-5edc-4872-b7c6-330c3397288e None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:55.121881 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 305/610] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jul 27 12:27:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 12:27:55.122726 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3cfa8-f706-4d27-993c-bd698b7c2bbb None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:55.135680 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff98b26-9023-4d58-b985-77d8181a7a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:55.136446 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff98b26-9023-4d58-b985-77d8181a7a1a None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:55.136737 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff98b26-9023-4d58-b985-77d8181a7a1a None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:55.137016 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff98b26-9023-4d58-b985-77d8181a7a1a None admin] PATH_INFO: `/v3/projects` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:55.137808 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff98b26-9023-4d58-b985-77d8181a7a1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:55.138123 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff98b26-9023-4d58-b985-77d8181a7a1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:55.139553 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff98b26-9023-4d58-b985-77d8181a7a1a None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:55.156297 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 306/611] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jul 27 12:27:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:55.156297 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff98b26-9023-4d58-b985-77d8181a7a1a None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:55.175912 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:55.219037 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3cfa8-f706-4d27-993c-bd698b7c2bbb None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:55.245223 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:55.253353 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff98b26-9023-4d58-b985-77d8181a7a1a None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:55.253729 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c946248-8c27-4ae5-b97c-608372eac4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:55.254371 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c946248-8c27-4ae5-b97c-608372eac4a2 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:55.254652 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c946248-8c27-4ae5-b97c-608372eac4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:55.254925 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c946248-8c27-4ae5-b97c-608372eac4a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:55.264612 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c946248-8c27-4ae5-b97c-608372eac4a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:55.266123 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c946248-8c27-4ae5-b97c-608372eac4a2 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:55.280399 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-6c946248-8c27-4ae5-b97c-608372eac4a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:55.280399 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:55.280399 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:55.280399 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:55.280399 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:55.280399 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:55.280399 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:55.280399 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:55.280399 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:55.280399 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:55.280399 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:55.280399 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:55.280399 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:27:55.280399 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:27:55.280399 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:27:55.281364 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:27:55.281364 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:55.281364 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:55.281364 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:55.281364 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:55.281364 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:55.281364 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:55.281364 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:55.281364 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:55.281364 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:55.281364 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:55.281364 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:55.281364 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:55.281364 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:55.281364 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:55.281364 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:55.281364 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:55.282341 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:27:55.282341 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:27:55.282341 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:55.282341 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:55.282341 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 306/612] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:27:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:55.282341 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c946248-8c27-4ae5-b97c-608372eac4a2 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:55.287977 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebdc4a4-f89d-4fbe-bd88-32c18aa34724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:55.288607 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdc4a4-f89d-4fbe-bd88-32c18aa34724 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:55.288885 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdc4a4-f89d-4fbe-bd88-32c18aa34724 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:55.289156 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdc4a4-f89d-4fbe-bd88-32c18aa34724 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:55.299567 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebdc4a4-f89d-4fbe-bd88-32c18aa34724 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:55.304832 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-5ebdc4a4-f89d-4fbe-bd88-32c18aa34724 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 12:27:55.304832 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:55.304832 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:55.304832 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:55.304832 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:55.304832 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:55.304832 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:55.304832 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:55.304832 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:55.304832 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:55.304832 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:55.304832 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:55.304832 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:55.304832 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:55.304832 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:55.304832 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:55.305814 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:55.305814 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:55.305814 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:55.305814 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:55.305814 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:55.305814 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:55.305814 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:55.305814 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:55.305814 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:55.305814 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:55.305814 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:55.305814 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:55.305814 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:55.305814 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:55.305814 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:55.305814 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:55.307253 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:55.307253 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:55.307253 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:55.307253 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:55.307253 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:55.307253 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:55.307253 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:55.307253 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:55.307253 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:55.307253 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:55.307253 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 12:27:55.307253 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:55.307253 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 307/613] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jul 27 12:27:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:55.307253 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebdc4a4-f89d-4fbe-bd88-32c18aa34724 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:55.383389 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c946248-8c27-4ae5-b97c-608372eac4a2 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:55.387307 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:55.405785 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebdc4a4-f89d-4fbe-bd88-32c18aa34724 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:55.416127 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be60ee-b5ee-4815-9e0f-800569a89dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:55.416767 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be60ee-b5ee-4815-9e0f-800569a89dea None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:55.417050 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be60ee-b5ee-4815-9e0f-800569a89dea None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:55.417331 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be60ee-b5ee-4815-9e0f-800569a89dea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:55.429046 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be60ee-b5ee-4815-9e0f-800569a89dea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:55.430578 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be60ee-b5ee-4815-9e0f-800569a89dea None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:55.439398 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ebb4a-5036-4564-a25f-3ebcd172bddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:55.440061 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ebb4a-5036-4564-a25f-3ebcd172bddd None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:55.440349 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ebb4a-5036-4564-a25f-3ebcd172bddd None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:55.440652 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ebb4a-5036-4564-a25f-3ebcd172bddd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:55.441411 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ebb4a-5036-4564-a25f-3ebcd172bddd None admin] RBAC: Adding query filter params (role.id=ec09bb8ea1664640a975563cc41cc39b, scope.project.id=e3316e9a169444ac827619608acc9fb7, user.id=36964c4644584d4282b04596ad20717c) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:55.441774 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ebb4a-5036-4564-a25f-3ebcd172bddd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:55.443174 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ebb4a-5036-4564-a25f-3ebcd172bddd None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:55.445004 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-f4be60ee-b5ee-4815-9e0f-800569a89dea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:55.445004 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:55.445004 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:55.445004 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:55.445004 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:55.445004 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:55.445004 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:55.445004 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:55.445004 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:55.445004 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:55.445004 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:55.445004 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:55.445004 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:27:55.445004 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:27:55.445004 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:27:55.446005 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:27:55.446005 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:55.446005 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:55.446005 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:55.446005 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:55.446005 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:55.446005 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:55.446005 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:55.446005 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:55.446005 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:55.446005 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:55.446005 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:55.446005 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:55.446005 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:55.446005 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:55.446005 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:55.446005 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:55.451758 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:27:55.451758 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:27:55.451758 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:55.451758 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:55.451758 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 307/614] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:27:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:55.451758 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be60ee-b5ee-4815-9e0f-800569a89dea None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:55.452122 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 308/615] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jul 27 12:27:55 2022] GET /identity/v3/role_assignments?user.id=36964c4644584d4282b04596ad20717c&scope.project.id=e3316e9a169444ac827619608acc9fb7&role.id=ec09bb8ea1664640a975563cc41cc39b => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:55.452122 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ebb4a-5036-4564-a25f-3ebcd172bddd None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:55.484572 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:55.567276 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be60ee-b5ee-4815-9e0f-800569a89dea None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:55.576103 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ebb4a-5036-4564-a25f-3ebcd172bddd None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:55.604046 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35de0c1-0374-4f6b-aa2a-46b5716ab406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:55.604679 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35de0c1-0374-4f6b-aa2a-46b5716ab406 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:55.604963 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35de0c1-0374-4f6b-aa2a-46b5716ab406 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:55.605241 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35de0c1-0374-4f6b-aa2a-46b5716ab406 None admin] PATH_INFO: `/v3/domains` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:55.605987 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35de0c1-0374-4f6b-aa2a-46b5716ab406 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:55.606292 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35de0c1-0374-4f6b-aa2a-46b5716ab406 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:55.607684 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35de0c1-0374-4f6b-aa2a-46b5716ab406 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:55.618956 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda8917-8ba4-4061-994d-1dd3ac6d095c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:55.620835 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda8917-8ba4-4061-994d-1dd3ac6d095c None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:55.620835 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda8917-8ba4-4061-994d-1dd3ac6d095c None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:55.620835 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda8917-8ba4-4061-994d-1dd3ac6d095c None admin] PATH_INFO: `/v3/roles` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:55.620835 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda8917-8ba4-4061-994d-1dd3ac6d095c None admin] RBAC: Adding query filter params (name=service) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:55.621151 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda8917-8ba4-4061-994d-1dd3ac6d095c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:55.626833 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 308/616] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:27:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:55.626833 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35de0c1-0374-4f6b-aa2a-46b5716ab406 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:55.627069 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda8917-8ba4-4061-994d-1dd3ac6d095c None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:55.631697 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 309/617] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jul 27 12:27:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:55.632582 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda8917-8ba4-4061-994d-1dd3ac6d095c None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:55.643677 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:55.736659 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:55.747790 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35de0c1-0374-4f6b-aa2a-46b5716ab406 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:55.755123 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda8917-8ba4-4061-994d-1dd3ac6d095c None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:55.790900 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d850260-eaa4-4286-8d14-a7e5cd653332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:55.791520 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d850260-eaa4-4286-8d14-a7e5cd653332 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:55.791800 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d850260-eaa4-4286-8d14-a7e5cd653332 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:55.792078 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d850260-eaa4-4286-8d14-a7e5cd653332 None admin] PATH_INFO: `/v3/domains` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:55.792769 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d850260-eaa4-4286-8d14-a7e5cd653332 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:55.793072 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d850260-eaa4-4286-8d14-a7e5cd653332 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:55.794460 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d850260-eaa4-4286-8d14-a7e5cd653332 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:55.800107 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f4ea6-60ce-4af4-b6cf-ea019764f452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:55.800752 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f4ea6-60ce-4af4-b6cf-ea019764f452 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:55.801037 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f4ea6-60ce-4af4-b6cf-ea019764f452 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:55.801314 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f4ea6-60ce-4af4-b6cf-ea019764f452 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:55.811189 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 309/618] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:27:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:55.811189 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d850260-eaa4-4286-8d14-a7e5cd653332 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:55.813221 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f4ea6-60ce-4af4-b6cf-ea019764f452 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:55.814345 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f4ea6-60ce-4af4-b6cf-ea019764f452 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:55.826102 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-b44f4ea6-60ce-4af4-b6cf-ea019764f452 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 12:27:55.826102 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:55.826102 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:55.826102 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:55.826102 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:55.826102 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:55.826102 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:55.826102 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:55.826102 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:55.826102 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:55.826102 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:55.826102 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:55.826102 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 12:27:55.826102 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 12:27:55.826102 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 12:27:55.826102 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 12:27:55.827071 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:55.827071 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:55.827071 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 12:27:55.827071 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:27:55.827071 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 12:27:55.827071 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:27:55.827071 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:55.827071 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:55.827071 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:55.827071 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:55.827071 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:55.827071 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:55.827071 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:55.827071 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:55.827071 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:55.827071 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:55.827071 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:55.827071 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:55.828035 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:55.828035 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:55.828035 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 12:27:55.828035 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 12:27:55.828035 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 12:27:55.828035 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 12:27:55.828035 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 12:27:55.828035 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 12:27:55.828035 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 12:27:55.828035 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:55.828035 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 310/619] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:27:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:55.828035 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f4ea6-60ce-4af4-b6cf-ea019764f452 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:55.900144 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:55.920363 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d850260-eaa4-4286-8d14-a7e5cd653332 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:55.938847 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f4ea6-60ce-4af4-b6cf-ea019764f452 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:55.954862 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd7152-f3a2-4263-82b0-924a9ddc421e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:55.955493 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd7152-f3a2-4263-82b0-924a9ddc421e None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:55.955780 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd7152-f3a2-4263-82b0-924a9ddc421e None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:55.956059 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd7152-f3a2-4263-82b0-924a9ddc421e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:55.966584 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd7152-f3a2-4263-82b0-924a9ddc421e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:55.968047 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd7152-f3a2-4263-82b0-924a9ddc421e None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:55.977335 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac85eb2-cd00-45f1-bbe2-2f009bef586b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:55.978207 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac85eb2-cd00-45f1-bbe2-2f009bef586b None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:55.978648 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac85eb2-cd00-45f1-bbe2-2f009bef586b None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:55.979109 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac85eb2-cd00-45f1-bbe2-2f009bef586b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:55.982927 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-ccbd7152-f3a2-4263-82b0-924a9ddc421e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:55.982927 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:55.982927 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:55.982927 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:55.982927 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:55.982927 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:55.982927 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:55.982927 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:55.982927 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:55.982927 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:55.982927 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:55.982927 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:55.982927 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:27:55.982927 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:27:55.982927 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:27:55.984060 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:27:55.984060 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:55.984060 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:55.984060 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:55.984060 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:55.984060 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:55.984060 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:55.984060 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:55.984060 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:55.984060 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:55.984060 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:55.984060 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:55.984060 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:55.984060 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:55.984060 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:55.984060 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:55.984060 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:55.985513 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:27:55.985513 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:27:55.985513 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:55.985513 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:55.985513 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 310/620] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:27:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:55.985513 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd7152-f3a2-4263-82b0-924a9ddc421e None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:55.989534 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac85eb2-cd00-45f1-bbe2-2f009bef586b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:55.991409 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac85eb2-cd00-45f1-bbe2-2f009bef586b None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:55.992578 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:56.005883 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-2ac85eb2-cd00-45f1-bbe2-2f009bef586b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 12:27:56.005883 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:56.005883 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:56.005883 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:56.005883 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:56.005883 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:56.005883 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:56.005883 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:56.005883 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:56.005883 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:56.005883 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:56.005883 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:56.005883 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 12:27:56.005883 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 12:27:56.005883 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 12:27:56.006997 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 12:27:56.006997 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:56.006997 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:56.006997 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:56.006997 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:56.006997 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:56.006997 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:56.006997 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:56.006997 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:56.006997 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:56.006997 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:56.006997 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:56.006997 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:56.006997 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:56.006997 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:56.006997 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:56.006997 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:56.008243 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 12:27:56.008243 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 12:27:56.008243 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 12:27:56.008243 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 12:27:56.008243 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 12:27:56.008243 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 12:27:56.008243 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 12:27:56.008243 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:56.010555 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 311/621] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jul 27 12:27:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:56.011551 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac85eb2-cd00-45f1-bbe2-2f009bef586b None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:56.097461 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd7152-f3a2-4263-82b0-924a9ddc421e None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:56.124184 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac85eb2-cd00-45f1-bbe2-2f009bef586b None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:56.133075 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7f2c0-a4f6-4f16-9147-4f77e9f89ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:56.133722 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7f2c0-a4f6-4f16-9147-4f77e9f89ae5 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:56.134011 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7f2c0-a4f6-4f16-9147-4f77e9f89ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:56.134278 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7f2c0-a4f6-4f16-9147-4f77e9f89ae5 None admin] PATH_INFO: `/v3/users` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:56.135067 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c7f2c0-a4f6-4f16-9147-4f77e9f89ae5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:56.135372 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c7f2c0-a4f6-4f16-9147-4f77e9f89ae5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:56.136948 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c7f2c0-a4f6-4f16-9147-4f77e9f89ae5 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:56.155212 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:56.160592 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 311/622] 10.222.0.55 () {56 vars in 1137 bytes} [Wed Jul 27 12:27:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:56.161289 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7f2c0-a4f6-4f16-9147-4f77e9f89ae5 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:56.167169 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7132a7b4-e3d5-4be8-9271-f5ceb95fc2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:56.167802 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132a7b4-e3d5-4be8-9271-f5ceb95fc2fb None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:56.168072 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132a7b4-e3d5-4be8-9271-f5ceb95fc2fb None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:56.168350 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132a7b4-e3d5-4be8-9271-f5ceb95fc2fb None admin] PATH_INFO: `/v3/domains` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:56.169046 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7132a7b4-e3d5-4be8-9271-f5ceb95fc2fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:56.169353 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7132a7b4-e3d5-4be8-9271-f5ceb95fc2fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:56.170757 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7132a7b4-e3d5-4be8-9271-f5ceb95fc2fb None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:56.184932 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 312/623] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:27:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:56.185610 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7132a7b4-e3d5-4be8-9271-f5ceb95fc2fb None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:56.230884 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:56.270168 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7f2c0-a4f6-4f16-9147-4f77e9f89ae5 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:56.291615 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7132a7b4-e3d5-4be8-9271-f5ceb95fc2fb None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:56.305845 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cbbebf-e06d-407a-868c-6e36ac8eac8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:56.306840 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbbebf-e06d-407a-868c-6e36ac8eac8a None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:56.307131 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbbebf-e06d-407a-868c-6e36ac8eac8a None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:56.307415 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbbebf-e06d-407a-868c-6e36ac8eac8a None admin] PATH_INFO: `/v3/projects` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:56.308164 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cbbebf-e06d-407a-868c-6e36ac8eac8a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:56.308472 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cbbebf-e06d-407a-868c-6e36ac8eac8a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:56.309911 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cbbebf-e06d-407a-868c-6e36ac8eac8a None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:56.321139 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 312/624] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jul 27 12:27:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:56.321973 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cbbebf-e06d-407a-868c-6e36ac8eac8a None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:56.332697 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd19837-4575-4eb4-a635-c81dbd6013fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:56.333640 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd19837-4575-4eb4-a635-c81dbd6013fc None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:56.334076 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd19837-4575-4eb4-a635-c81dbd6013fc None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:56.334584 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd19837-4575-4eb4-a635-c81dbd6013fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:56.391423 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:56.408400 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd19837-4575-4eb4-a635-c81dbd6013fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:56.410282 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd19837-4575-4eb4-a635-c81dbd6013fc None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:56.434923 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cbbebf-e06d-407a-868c-6e36ac8eac8a None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:56.456688 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:56.470229 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835b6f7-2dff-4d5b-b31e-d5ec9ead5a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:56.470868 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835b6f7-2dff-4d5b-b31e-d5ec9ead5a0e None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:56.471148 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835b6f7-2dff-4d5b-b31e-d5ec9ead5a0e None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:56.471421 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835b6f7-2dff-4d5b-b31e-d5ec9ead5a0e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:56.478994 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835b6f7-2dff-4d5b-b31e-d5ec9ead5a0e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:56.480416 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835b6f7-2dff-4d5b-b31e-d5ec9ead5a0e None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:56.492518 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-d835b6f7-2dff-4d5b-b31e-d5ec9ead5a0e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 12:27:56.492518 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:56.492518 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:56.492518 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:56.492518 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:56.492518 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:56.492518 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:56.492518 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:56.492518 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:56.492518 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:56.492518 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:56.492518 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:56.492518 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 12:27:56.492518 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 12:27:56.492518 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 12:27:56.492518 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 12:27:56.493511 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:56.493511 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:56.493511 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 12:27:56.493511 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:27:56.493511 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 12:27:56.493511 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:27:56.493511 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:56.493511 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:56.493511 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:56.493511 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:56.493511 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:56.493511 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:56.493511 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:56.493511 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:56.493511 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:56.493511 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:56.493511 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:56.493511 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:56.494946 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:56.494946 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:56.494946 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 12:27:56.494946 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 12:27:56.494946 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 12:27:56.494946 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 12:27:56.494946 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 12:27:56.494946 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 12:27:56.494946 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 12:27:56.494946 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:56.494946 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 313/625] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jul 27 12:27:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:56.494946 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835b6f7-2dff-4d5b-b31e-d5ec9ead5a0e None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:56.518855 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 313/626] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jul 27 12:27:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 12:27:56.519706 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd19837-4575-4eb4-a635-c81dbd6013fc None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:56.601008 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835b6f7-2dff-4d5b-b31e-d5ec9ead5a0e None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:56.616578 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:56.633736 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd19837-4575-4eb4-a635-c81dbd6013fc None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:56.640163 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffde589-e22e-4be2-a3ca-8903bc6dff88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:56.640821 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffde589-e22e-4be2-a3ca-8903bc6dff88 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:56.641693 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffde589-e22e-4be2-a3ca-8903bc6dff88 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:56.641928 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffde589-e22e-4be2-a3ca-8903bc6dff88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:56.642709 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffde589-e22e-4be2-a3ca-8903bc6dff88 None admin] RBAC: Adding query filter params (role.id=ec09bb8ea1664640a975563cc41cc39b, scope.project.id=e3316e9a169444ac827619608acc9fb7, user.id=a436eb33e8b040d192f1cfc9771fd351) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:56.643040 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffde589-e22e-4be2-a3ca-8903bc6dff88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:56.644463 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffde589-e22e-4be2-a3ca-8903bc6dff88 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:56.650491 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 314/627] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jul 27 12:27:56 2022] GET /identity/v3/role_assignments?user.id=a436eb33e8b040d192f1cfc9771fd351&scope.project.id=e3316e9a169444ac827619608acc9fb7&role.id=ec09bb8ea1664640a975563cc41cc39b => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:56.651585 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffde589-e22e-4be2-a3ca-8903bc6dff88 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:56.692756 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb49a96-ce89-4461-a22b-c0fba8ce42fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:56.693738 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb49a96-ce89-4461-a22b-c0fba8ce42fa None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:56.694827 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb49a96-ce89-4461-a22b-c0fba8ce42fa None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:56.695471 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb49a96-ce89-4461-a22b-c0fba8ce42fa None admin] PATH_INFO: `/v3/users` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:56.696610 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb49a96-ce89-4461-a22b-c0fba8ce42fa None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:56.697431 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb49a96-ce89-4461-a22b-c0fba8ce42fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:56.700095 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb49a96-ce89-4461-a22b-c0fba8ce42fa None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:56.721854 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:56.735656 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 314/628] 10.222.0.55 () {56 vars in 1139 bytes} [Wed Jul 27 12:27:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:56.736882 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb49a96-ce89-4461-a22b-c0fba8ce42fa None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:56.792249 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffde589-e22e-4be2-a3ca-8903bc6dff88 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:56.831231 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c950af0-56d8-47ce-b86d-e12ef6675fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:56.832145 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c950af0-56d8-47ce-b86d-e12ef6675fe8 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:56.832257 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c950af0-56d8-47ce-b86d-e12ef6675fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:56.832461 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c950af0-56d8-47ce-b86d-e12ef6675fe8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:56.844817 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c950af0-56d8-47ce-b86d-e12ef6675fe8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:56.846332 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c950af0-56d8-47ce-b86d-e12ef6675fe8 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:56.862959 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-2c950af0-56d8-47ce-b86d-e12ef6675fe8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:56.862959 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:56.862959 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:56.862959 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:56.862959 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:56.862959 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:56.862959 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:56.862959 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:56.862959 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:56.862959 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:56.862959 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:56.862959 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:56.862959 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:27:56.862959 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:27:56.862959 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:27:56.863921 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:27:56.863921 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:56.863921 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:56.863921 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:56.863921 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:56.863921 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:56.863921 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:56.863921 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:56.863921 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:56.863921 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:56.863921 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:56.863921 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:56.863921 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:56.863921 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:56.863921 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:56.863921 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:56.863921 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:56.864903 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:27:56.864903 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:27:56.864903 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:56.864903 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:56.864903 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 315/629] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:27:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:56.873694 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c950af0-56d8-47ce-b86d-e12ef6675fe8 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:56.886807 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb49a96-ce89-4461-a22b-c0fba8ce42fa None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:56.932912 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece42dd8-9218-4310-8846-82228ceffb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:56.933098 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece42dd8-9218-4310-8846-82228ceffb99 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:56.934437 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece42dd8-9218-4310-8846-82228ceffb99 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:56.934437 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece42dd8-9218-4310-8846-82228ceffb99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:56.950584 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:57.005991 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:57.010833 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c950af0-56d8-47ce-b86d-e12ef6675fe8 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:57.027839 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece42dd8-9218-4310-8846-82228ceffb99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:57.029419 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece42dd8-9218-4310-8846-82228ceffb99 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:57.050861 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0bd54-8e45-46cd-82aa-980e39e87967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:57.051835 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0bd54-8e45-46cd-82aa-980e39e87967 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:57.052291 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0bd54-8e45-46cd-82aa-980e39e87967 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:57.052748 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0bd54-8e45-46cd-82aa-980e39e87967 None admin] PATH_INFO: `/v3/domains` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:57.053684 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0bd54-8e45-46cd-82aa-980e39e87967 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:57.054163 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0bd54-8e45-46cd-82aa-980e39e87967 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:57.055815 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0bd54-8e45-46cd-82aa-980e39e87967 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:57.073813 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 316/630] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:27:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:27:57.075410 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0bd54-8e45-46cd-82aa-980e39e87967 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:57.143273 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 315/631] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jul 27 12:27:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 12:27:57.148613 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece42dd8-9218-4310-8846-82228ceffb99 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:57.179369 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0bd54-8e45-46cd-82aa-980e39e87967 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:57.209302 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:57.221539 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c150d-8b36-4525-b77a-684fc51ff142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:57.222480 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c150d-8b36-4525-b77a-684fc51ff142 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:57.222988 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c150d-8b36-4525-b77a-684fc51ff142 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:57.223458 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c150d-8b36-4525-b77a-684fc51ff142 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:57.231768 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3c150d-8b36-4525-b77a-684fc51ff142 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:57.233570 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3c150d-8b36-4525-b77a-684fc51ff142 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:57.245713 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-8a3c150d-8b36-4525-b77a-684fc51ff142 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 12:27:57.245713 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:57.245713 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:57.245713 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:57.245713 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:57.245713 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:57.245713 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:57.245713 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:57.245713 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:57.245713 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:57.245713 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:57.245713 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:57.245713 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 12:27:57.245713 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 12:27:57.245713 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 12:27:57.246637 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 12:27:57.246637 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:57.246637 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:57.246637 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:57.246637 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:57.246637 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:57.246637 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:57.246637 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:57.246637 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:57.246637 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:57.246637 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:57.246637 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:57.246637 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:57.246637 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:57.246637 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:57.246637 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:57.246637 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:57.247520 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 12:27:57.247520 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 12:27:57.247520 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 12:27:57.247520 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 12:27:57.247520 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 12:27:57.247520 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 12:27:57.247520 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 12:27:57.247520 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:57.254872 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 317/632] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jul 27 12:27:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 12:27:57.258246 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c150d-8b36-4525-b77a-684fc51ff142 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:57.281624 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece42dd8-9218-4310-8846-82228ceffb99 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:57.295154 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:57.330889 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14938528-6b33-4554-882c-d90a29f12218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:57.331548 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14938528-6b33-4554-882c-d90a29f12218 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:57.331825 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14938528-6b33-4554-882c-d90a29f12218 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:57.332095 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14938528-6b33-4554-882c-d90a29f12218 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:57.346674 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14938528-6b33-4554-882c-d90a29f12218 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:57.349161 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14938528-6b33-4554-882c-d90a29f12218 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:57.365525 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c150d-8b36-4525-b77a-684fc51ff142 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:57.370748 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-14938528-6b33-4554-882c-d90a29f12218 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:57.370748 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:57.370748 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:57.370748 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:57.370748 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:57.370748 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:57.370748 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:57.370748 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:57.370748 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:57.370748 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:57.370748 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:57.370748 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:57.370748 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:27:57.370748 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:27:57.370748 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:27:57.371632 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:27:57.371632 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:57.371632 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:57.371632 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:57.371632 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:57.371632 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:57.371632 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:57.371632 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:57.371632 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:57.371632 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:57.371632 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:57.371632 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:57.371632 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:57.371632 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:57.371632 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:57.371632 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:57.371632 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:57.372561 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:27:57.372561 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:27:57.372561 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:57.372561 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:57.375771 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 316/633] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:27:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 12:27:57.382415 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14938528-6b33-4554-882c-d90a29f12218 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:57.413322 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09ea04-0f53-4b06-9f38-b2e8fb309841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:57.414914 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09ea04-0f53-4b06-9f38-b2e8fb309841 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:57.415411 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09ea04-0f53-4b06-9f38-b2e8fb309841 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:57.416127 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09ea04-0f53-4b06-9f38-b2e8fb309841 None admin] PATH_INFO: `/v3/projects` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:57.417321 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd09ea04-0f53-4b06-9f38-b2e8fb309841 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:57.418227 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd09ea04-0f53-4b06-9f38-b2e8fb309841 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:57.420155 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd09ea04-0f53-4b06-9f38-b2e8fb309841 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:57.438363 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 318/634] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jul 27 12:27:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:27:57.443913 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09ea04-0f53-4b06-9f38-b2e8fb309841 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:57.492954 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:57.500058 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14938528-6b33-4554-882c-d90a29f12218 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:57.527293 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:57.536384 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684f198-adc3-49ec-9e9e-758d6639e605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:57.537130 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684f198-adc3-49ec-9e9e-758d6639e605 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:57.537518 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684f198-adc3-49ec-9e9e-758d6639e605 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:57.537917 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684f198-adc3-49ec-9e9e-758d6639e605 None admin] PATH_INFO: `/v3/domains` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:57.538701 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a684f198-adc3-49ec-9e9e-758d6639e605 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:57.539367 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a684f198-adc3-49ec-9e9e-758d6639e605 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:57.540724 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a684f198-adc3-49ec-9e9e-758d6639e605 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:57.553003 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09ea04-0f53-4b06-9f38-b2e8fb309841 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:57.558737 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 317/635] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:57.559748 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684f198-adc3-49ec-9e9e-758d6639e605 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:57.590936 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea9568-323d-455a-bacb-00d0bb6523dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:57.591873 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea9568-323d-455a-bacb-00d0bb6523dd None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:57.592330 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea9568-323d-455a-bacb-00d0bb6523dd None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:57.592754 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea9568-323d-455a-bacb-00d0bb6523dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:57.593706 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea9568-323d-455a-bacb-00d0bb6523dd None admin] RBAC: Adding query filter params (role.id=ec09bb8ea1664640a975563cc41cc39b, scope.project.id=e3316e9a169444ac827619608acc9fb7, user.id=e6ead01964e14f389bcfca4e9d9b6475) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:57.594297 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea9568-323d-455a-bacb-00d0bb6523dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:57.595945 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea9568-323d-455a-bacb-00d0bb6523dd None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:57.610305 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 319/636] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jul 27 12:27:57 2022] GET /identity/v3/role_assignments?user.id=e6ead01964e14f389bcfca4e9d9b6475&scope.project.id=e3316e9a169444ac827619608acc9fb7&role.id=ec09bb8ea1664640a975563cc41cc39b => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:27:57.673693 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684f198-adc3-49ec-9e9e-758d6639e605 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:57.714175 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ffa17-bf6d-4cf8-a759-f5018578d09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:57.714838 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ffa17-bf6d-4cf8-a759-f5018578d09f None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:57.715121 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ffa17-bf6d-4cf8-a759-f5018578d09f None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:57.715396 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ffa17-bf6d-4cf8-a759-f5018578d09f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:57.723402 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ffa17-bf6d-4cf8-a759-f5018578d09f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:57.724964 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ffa17-bf6d-4cf8-a759-f5018578d09f None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:57.738212 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-dd1ffa17-bf6d-4cf8-a759-f5018578d09f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 12:27:57.738212 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:57.738212 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:57.738212 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:57.738212 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:57.738212 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:57.738212 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:57.738212 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:57.738212 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:57.738212 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:57.738212 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:57.738212 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:57.738212 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 12:27:57.738212 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 12:27:57.738212 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 12:27:57.739178 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 12:27:57.739178 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:57.739178 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:57.739178 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:57.739178 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:57.739178 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:57.739178 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:57.739178 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:57.739178 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:57.739178 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:57.739178 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:57.739178 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:57.739178 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:57.739178 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:57.739178 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:57.739178 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:57.739178 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:57.740098 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 12:27:57.740098 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 12:27:57.740098 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 12:27:57.740098 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 12:27:57.740098 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 12:27:57.740098 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 12:27:57.740098 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 12:27:57.740098 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:57.740098 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 318/637] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jul 27 12:27:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:57.746409 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea9568-323d-455a-bacb-00d0bb6523dd None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:57.835097 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6681f3-e4c7-49cf-9038-5641b9709d77 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:57.835359 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6681f3-e4c7-49cf-9038-5641b9709d77 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:57.835668 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6681f3-e4c7-49cf-9038-5641b9709d77 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:57.837267 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 319/638] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 12:27:57.842270 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af75998-d19b-43f6-a0b9-3a06fa402a58 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:57.842558 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af75998-d19b-43f6-a0b9-3a06fa402a58 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:57.842836 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af75998-d19b-43f6-a0b9-3a06fa402a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:57.864242 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea9568-323d-455a-bacb-00d0bb6523dd None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:57.865049 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-3af75998-d19b-43f6-a0b9-3a06fa402a58 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:57.866555 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-3af75998-d19b-43f6-a0b9-3a06fa402a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:57.877960 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:57.906246 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a288dbd-9502-4d5e-b27a-882e955dc934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:57.907409 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a288dbd-9502-4d5e-b27a-882e955dc934 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:57.907693 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a288dbd-9502-4d5e-b27a-882e955dc934 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:57.907971 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a288dbd-9502-4d5e-b27a-882e955dc934 None admin] PATH_INFO: `/v3/projects` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:57.908728 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a288dbd-9502-4d5e-b27a-882e955dc934 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:57.909034 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a288dbd-9502-4d5e-b27a-882e955dc934 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:57.910885 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a288dbd-9502-4d5e-b27a-882e955dc934 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:57.926683 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 320/639] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jul 27 12:27:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:57.932479 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a288dbd-9502-4d5e-b27a-882e955dc934 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:57.941294 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:57.951075 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 320/640] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 12:27:57.975835 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af75998-d19b-43f6-a0b9-3a06fa402a58 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:58.043763 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a288dbd-9502-4d5e-b27a-882e955dc934 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:58.087246 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af75998-d19b-43f6-a0b9-3a06fa402a58 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:58.088168 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad86f7-85e6-4e38-bfa6-8bcb8736390c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:58.089053 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad86f7-85e6-4e38-bfa6-8bcb8736390c None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:58.090209 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad86f7-85e6-4e38-bfa6-8bcb8736390c None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:58.090570 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad86f7-85e6-4e38-bfa6-8bcb8736390c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:58.091500 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad86f7-85e6-4e38-bfa6-8bcb8736390c None admin] RBAC: Adding query filter params (role.id=ec09bb8ea1664640a975563cc41cc39b, scope.project.id=e3316e9a169444ac827619608acc9fb7, user.id=645587202a91426c98f86abdcddce8cd) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:58.091878 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad86f7-85e6-4e38-bfa6-8bcb8736390c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:58.093422 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad86f7-85e6-4e38-bfa6-8bcb8736390c None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:58.109971 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 321/641] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jul 27 12:27:57 2022] GET /identity/v3/role_assignments?user.id=645587202a91426c98f86abdcddce8cd&scope.project.id=e3316e9a169444ac827619608acc9fb7&role.id=ec09bb8ea1664640a975563cc41cc39b => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:27:58.126123 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180fc32-cc12-4dd2-8a4a-1003aece9652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:58.126802 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180fc32-cc12-4dd2-8a4a-1003aece9652 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:58.127091 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180fc32-cc12-4dd2-8a4a-1003aece9652 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:58.127415 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180fc32-cc12-4dd2-8a4a-1003aece9652 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:58.140372 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c180fc32-cc12-4dd2-8a4a-1003aece9652 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:27:58.145841 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-c180fc32-cc12-4dd2-8a4a-1003aece9652 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 12:27:58.145841 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:58.145841 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:58.145841 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:58.145841 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:58.145841 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:58.145841 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:58.145841 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:58.145841 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:58.145841 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:58.145841 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:58.145841 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:58.145841 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:27:58.145841 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:27:58.145841 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:27:58.145841 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:27:58.147138 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:27:58.147138 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:27:58.147138 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:27:58.147138 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:27:58.147138 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:58.147138 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:58.147138 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:58.147138 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:58.147138 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:58.147138 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:58.147138 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:58.147138 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:58.147138 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:58.147138 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:58.147138 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:58.147138 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:58.148347 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:58.148347 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:58.148347 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:58.148347 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:58.148347 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:27:58.148347 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:27:58.148347 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:27:58.148347 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:27:58.148347 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:27:58.148347 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:27:58.148347 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 12:27:58.148347 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:58.148347 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 321/642] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jul 27 12:27:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 12:27:58.153309 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad86f7-85e6-4e38-bfa6-8bcb8736390c None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:58.242025 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:58.270092 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad86f7-85e6-4e38-bfa6-8bcb8736390c None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:58.305024 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9baa4-82f7-4f1a-9474-a3e403b61bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:58.305572 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9baa4-82f7-4f1a-9474-a3e403b61bd6 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:58.305884 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9baa4-82f7-4f1a-9474-a3e403b61bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:58.306161 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9baa4-82f7-4f1a-9474-a3e403b61bd6 None admin] PATH_INFO: `/v3/roles` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:58.306876 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a9baa4-82f7-4f1a-9474-a3e403b61bd6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:58.307179 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a9baa4-82f7-4f1a-9474-a3e403b61bd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:58.308543 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a9baa4-82f7-4f1a-9474-a3e403b61bd6 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:58.317327 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 322/643] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:27:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:58.322995 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180fc32-cc12-4dd2-8a4a-1003aece9652 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:58.332839 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:58.428298 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180fc32-cc12-4dd2-8a4a-1003aece9652 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:58.466073 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a1164-0ee4-4576-a1c8-13eed7ff30b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:58.466767 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a1164-0ee4-4576-a1c8-13eed7ff30b9 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:58.467053 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a1164-0ee4-4576-a1c8-13eed7ff30b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:58.467328 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a1164-0ee4-4576-a1c8-13eed7ff30b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:58.478939 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a1164-0ee4-4576-a1c8-13eed7ff30b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:58.480516 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a1164-0ee4-4576-a1c8-13eed7ff30b9 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:58.498219 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-e53a1164-0ee4-4576-a1c8-13eed7ff30b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:58.498219 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:58.498219 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:58.498219 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:58.498219 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:58.498219 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:58.498219 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:58.498219 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:58.498219 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:58.498219 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:58.498219 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:58.498219 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:58.498219 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:27:58.498219 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:27:58.498219 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:27:58.499186 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:27:58.499186 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:58.499186 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:58.499186 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:58.499186 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:58.499186 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:58.499186 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:58.499186 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:58.499186 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:58.499186 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:58.499186 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:58.499186 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:58.499186 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:58.499186 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:58.499186 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:58.499186 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:58.499186 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:58.501283 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:27:58.501283 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:27:58.501283 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:58.501283 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:58.501283 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 322/644] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:27:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:58.505452 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9baa4-82f7-4f1a-9474-a3e403b61bd6 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:58.614300 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9baa4-82f7-4f1a-9474-a3e403b61bd6 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:58.642121 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:58.651932 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c2e05-6bb8-4694-ae79-dd6b8c6e9a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:58.652844 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c2e05-6bb8-4694-ae79-dd6b8c6e9a40 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:58.653355 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c2e05-6bb8-4694-ae79-dd6b8c6e9a40 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:58.653905 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c2e05-6bb8-4694-ae79-dd6b8c6e9a40 None admin] PATH_INFO: `/v3/domains` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:58.654803 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c2e05-6bb8-4694-ae79-dd6b8c6e9a40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:58.655323 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c2e05-6bb8-4694-ae79-dd6b8c6e9a40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:58.657519 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c2e05-6bb8-4694-ae79-dd6b8c6e9a40 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:58.670840 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 323/645] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:27:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:27:58.676682 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a1164-0ee4-4576-a1c8-13eed7ff30b9 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:58.738272 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:58.782483 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a1164-0ee4-4576-a1c8-13eed7ff30b9 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:58.822539 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339c8b8-5bc9-4249-a5d5-b5087bf06d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:58.823196 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339c8b8-5bc9-4249-a5d5-b5087bf06d87 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:58.823480 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339c8b8-5bc9-4249-a5d5-b5087bf06d87 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:58.823848 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339c8b8-5bc9-4249-a5d5-b5087bf06d87 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:58.832199 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339c8b8-5bc9-4249-a5d5-b5087bf06d87 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:58.833682 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339c8b8-5bc9-4249-a5d5-b5087bf06d87 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:58.844982 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-a339c8b8-5bc9-4249-a5d5-b5087bf06d87 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 12:27:58.844982 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:58.844982 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:58.844982 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:58.844982 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:58.844982 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:58.844982 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:58.844982 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:58.844982 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:58.844982 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:58.844982 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:58.844982 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:58.844982 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 12:27:58.844982 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 12:27:58.844982 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 12:27:58.844982 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 12:27:58.845943 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:58.845943 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:58.845943 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 12:27:58.845943 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:27:58.845943 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 12:27:58.845943 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:27:58.845943 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:58.845943 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:58.845943 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:58.845943 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:58.845943 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:58.845943 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:58.845943 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:58.845943 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:58.845943 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:58.845943 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:58.845943 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:58.845943 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:58.847133 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:58.847133 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:58.847133 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 12:27:58.847133 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 12:27:58.847133 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 12:27:58.847133 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 12:27:58.847133 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 12:27:58.847133 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 12:27:58.847133 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 12:27:58.847133 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:58.847133 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 323/646] 10.222.0.55 () {56 vars in 1093 bytes} [Wed Jul 27 12:27:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:58.852021 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c2e05-6bb8-4694-ae79-dd6b8c6e9a40 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:58.960037 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c2e05-6bb8-4694-ae79-dd6b8c6e9a40 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:58.996821 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb74adb-90c1-4039-8e32-63d95c97a3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:58.997450 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb74adb-90c1-4039-8e32-63d95c97a3cf None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:58.997841 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb74adb-90c1-4039-8e32-63d95c97a3cf None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:58.998122 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb74adb-90c1-4039-8e32-63d95c97a3cf None admin] PATH_INFO: `/v3/users` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:58.998922 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb74adb-90c1-4039-8e32-63d95c97a3cf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:58.999230 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb74adb-90c1-4039-8e32-63d95c97a3cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:59.000752 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb74adb-90c1-4039-8e32-63d95c97a3cf None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:59.018693 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 324/647] 10.222.0.55 () {56 vars in 1133 bytes} [Wed Jul 27 12:27:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:59.024353 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339c8b8-5bc9-4249-a5d5-b5087bf06d87 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:59.100325 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21698898-693c-46a7-8bd3-098b2260b77f None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:59.100620 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21698898-693c-46a7-8bd3-098b2260b77f None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:59.100893 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21698898-693c-46a7-8bd3-098b2260b77f None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:59.102543 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 325/648] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 12:27:59.107345 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3917e-2ead-4184-ba70-1c42200951a4 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:59.107635 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3917e-2ead-4184-ba70-1c42200951a4 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:59.107915 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3917e-2ead-4184-ba70-1c42200951a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:59.127429 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-2cf3917e-2ead-4184-ba70-1c42200951a4 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:27:59.128627 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-2cf3917e-2ead-4184-ba70-1c42200951a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:27:59.133465 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339c8b8-5bc9-4249-a5d5-b5087bf06d87 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:59.157416 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:59.189069 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df17bcd-1bf4-46a5-9a69-845fbd13bb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:59.190119 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df17bcd-1bf4-46a5-9a69-845fbd13bb48 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:59.190609 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df17bcd-1bf4-46a5-9a69-845fbd13bb48 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:59.191086 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df17bcd-1bf4-46a5-9a69-845fbd13bb48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:59.191206 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:59.225943 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 326/649] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:27:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 12:27:59.253898 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf3917e-2ead-4184-ba70-1c42200951a4 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:59.281118 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df17bcd-1bf4-46a5-9a69-845fbd13bb48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:59.283202 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df17bcd-1bf4-46a5-9a69-845fbd13bb48 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:59.368785 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf3917e-2ead-4184-ba70-1c42200951a4 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:59.391626 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 324/650] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jul 27 12:27:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 12:27:59.397175 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df17bcd-1bf4-46a5-9a69-845fbd13bb48 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:59.408296 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce617f-fabc-496f-a8f6-f1c19c1668a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:59.409319 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce617f-fabc-496f-a8f6-f1c19c1668a5 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:59.409850 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce617f-fabc-496f-a8f6-f1c19c1668a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:59.410348 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce617f-fabc-496f-a8f6-f1c19c1668a5 None admin] PATH_INFO: `/v3/services/image` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:59.411295 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce617f-fabc-496f-a8f6-f1c19c1668a5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:59.412975 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce617f-fabc-496f-a8f6-f1c19c1668a5 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:59.415756 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:59.427651 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-6fce617f-fabc-496f-a8f6-f1c19c1668a5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 12:27:59.427651 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:59.427651 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 12:27:59.427651 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 12:27:59.427651 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 12:27:59.427651 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 12:27:59.427651 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 12:27:59.427651 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 12:27:59.427651 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 12:27:59.427651 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:59.427651 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 12:27:59.427651 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:59.427651 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:59.427651 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:59.427651 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:59.427651 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:59.427651 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:59.428753 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:59.428753 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:59.428753 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:59.428753 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:59.428753 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:59.428753 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:59.428753 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 12:27:59.428753 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 12:27:59.428753 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 12:27:59.428753 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 12:27:59.428753 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:59.428753 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:59.428753 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:59.428753 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:59.428753 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:59.428753 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:59.429647 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:59.429647 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:59.429647 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:59.429647 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:59.429647 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:59.429647 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:59.429647 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:59.429647 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:59.429647 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:59.429647 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:59.429647 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 12:27:59.429647 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 12:27:59.429647 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 12:27:59.429647 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:27:59.437449 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 327/651] 10.222.0.55 () {56 vars in 1105 bytes} [Wed Jul 27 12:27:59 2022] GET /identity/v3/services/image => generated 86 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:59.439463 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce617f-fabc-496f-a8f6-f1c19c1668a5 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:59.487455 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:59.502878 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df17bcd-1bf4-46a5-9a69-845fbd13bb48 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:59.539770 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d33b0-9f79-4efc-b1e2-a3762ab36aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:59.540421 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d33b0-9f79-4efc-b1e2-a3762ab36aa6 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:59.540708 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d33b0-9f79-4efc-b1e2-a3762ab36aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:59.540992 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d33b0-9f79-4efc-b1e2-a3762ab36aa6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:59.551808 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d33b0-9f79-4efc-b1e2-a3762ab36aa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:59.553259 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d33b0-9f79-4efc-b1e2-a3762ab36aa6 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:59.557328 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce617f-fabc-496f-a8f6-f1c19c1668a5 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:59.569038 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-390d33b0-9f79-4efc-b1e2-a3762ab36aa6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:59.569038 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:59.569038 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:59.569038 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:59.569038 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:59.569038 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:59.569038 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:59.569038 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:59.569038 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:59.569038 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:59.569038 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:59.569038 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:59.569038 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:27:59.569038 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:27:59.569038 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:27:59.570007 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:27:59.570007 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:59.570007 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:59.570007 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:59.570007 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:59.570007 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:59.570007 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:59.570007 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:59.570007 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:59.570007 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:59.570007 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:59.570007 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:59.570007 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:59.570007 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:59.570007 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:59.570007 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:59.570007 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:59.570903 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:27:59.570903 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:27:59.570903 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:27:59.570903 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:59.570903 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 325/652] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:27:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 12:27:59.575886 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d33b0-9f79-4efc-b1e2-a3762ab36aa6 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:59.598541 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7888c-3b22-4c2b-a30e-d492c3e8160f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:59.599609 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7888c-3b22-4c2b-a30e-d492c3e8160f None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:59.600095 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7888c-3b22-4c2b-a30e-d492c3e8160f None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:59.600603 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7888c-3b22-4c2b-a30e-d492c3e8160f None admin] PATH_INFO: `/v3/services` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:59.601770 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7888c-3b22-4c2b-a30e-d492c3e8160f None admin] RBAC: Adding query filter params (name=image) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:59.602395 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7888c-3b22-4c2b-a30e-d492c3e8160f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:59.604030 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7888c-3b22-4c2b-a30e-d492c3e8160f None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:59.614198 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 328/653] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:27:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:59.615487 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7888c-3b22-4c2b-a30e-d492c3e8160f None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:59.649216 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:59.682428 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d33b0-9f79-4efc-b1e2-a3762ab36aa6 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:59.719514 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87413dae-b673-4bd9-a91c-1e5bc75e3799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:59.720146 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87413dae-b673-4bd9-a91c-1e5bc75e3799 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:59.720428 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87413dae-b673-4bd9-a91c-1e5bc75e3799 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:59.720710 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87413dae-b673-4bd9-a91c-1e5bc75e3799 None admin] PATH_INFO: `/v3/domains` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:59.721406 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87413dae-b673-4bd9-a91c-1e5bc75e3799 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:59.721765 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87413dae-b673-4bd9-a91c-1e5bc75e3799 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:59.723125 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87413dae-b673-4bd9-a91c-1e5bc75e3799 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:59.733002 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7888c-3b22-4c2b-a30e-d492c3e8160f None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:59.736470 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:59.743697 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 326/654] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:27:59.744646 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87413dae-b673-4bd9-a91c-1e5bc75e3799 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:27:59.775559 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615e964-398f-41b3-8994-df82ebb35b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:59.776580 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615e964-398f-41b3-8994-df82ebb35b64 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:59.777067 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615e964-398f-41b3-8994-df82ebb35b64 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:59.777559 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615e964-398f-41b3-8994-df82ebb35b64 None admin] PATH_INFO: `/v3/services` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:59.778634 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9615e964-398f-41b3-8994-df82ebb35b64 None admin] RBAC: Adding query filter params (type=image) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:27:59.779153 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9615e964-398f-41b3-8994-df82ebb35b64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:59.780780 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9615e964-398f-41b3-8994-df82ebb35b64 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:59.793738 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 329/655] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:27:59 2022] GET /identity/v3/services?type=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:27:59.861161 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87413dae-b673-4bd9-a91c-1e5bc75e3799 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:27:59.894453 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:27:59.900954 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b7325-4cbf-451b-93ae-c9289c4c5f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:27:59.901625 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b7325-4cbf-451b-93ae-c9289c4c5f13 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:27:59.901927 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b7325-4cbf-451b-93ae-c9289c4c5f13 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:27:59.902205 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b7325-4cbf-451b-93ae-c9289c4c5f13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:27:59.909997 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b7325-4cbf-451b-93ae-c9289c4c5f13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:27:59.911490 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b7325-4cbf-451b-93ae-c9289c4c5f13 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:27:59.924564 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-ab7b7325-4cbf-451b-93ae-c9289c4c5f13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 12:27:59.924564 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:27:59.924564 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:27:59.924564 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:27:59.924564 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:27:59.924564 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:27:59.924564 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:27:59.924564 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:27:59.924564 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:27:59.924564 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:27:59.924564 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:27:59.924564 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:27:59.924564 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 12:27:59.924564 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 12:27:59.924564 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 12:27:59.925797 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 12:27:59.925797 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:27:59.925797 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:27:59.925797 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:27:59.925797 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:27:59.925797 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:27:59.925797 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:27:59.925797 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:27:59.925797 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:27:59.925797 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:27:59.925797 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:27:59.925797 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:27:59.925797 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:27:59.925797 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:27:59.925797 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:27:59.925797 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:27:59.925797 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:27:59.926685 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 12:27:59.926685 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 12:27:59.926685 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 12:27:59.926685 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 12:27:59.926685 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 12:27:59.926685 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 12:27:59.926685 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 12:27:59.926685 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:27:59.928097 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 327/656] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jul 27 12:27:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:27:59.934417 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615e964-398f-41b3-8994-df82ebb35b64 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:00.065145 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615e964-398f-41b3-8994-df82ebb35b64 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:00.101426 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20c698-892e-46f3-af40-375021bd2494 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:00.101992 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20c698-892e-46f3-af40-375021bd2494 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:00.101992 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20c698-892e-46f3-af40-375021bd2494 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:00.104773 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978982de-c384-47e5-af7e-69845f4fb6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:00.105851 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978982de-c384-47e5-af7e-69845f4fb6c0 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:00.106506 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978982de-c384-47e5-af7e-69845f4fb6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:00.106772 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978982de-c384-47e5-af7e-69845f4fb6c0 None admin] PATH_INFO: `/v3/projects` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:00.107117 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 328/657] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 12:28:00.108390 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978982de-c384-47e5-af7e-69845f4fb6c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:00.108390 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978982de-c384-47e5-af7e-69845f4fb6c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:00.109093 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83db3d-a362-4d78-9d9c-83b35f8d4716 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:00.109380 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83db3d-a362-4d78-9d9c-83b35f8d4716 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:00.110233 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83db3d-a362-4d78-9d9c-83b35f8d4716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:00.111063 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978982de-c384-47e5-af7e-69845f4fb6c0 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:00.127288 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 330/658] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jul 27 12:27:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:28:00.130122 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-fe83db3d-a362-4d78-9d9c-83b35f8d4716 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:28:00.131312 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-fe83db3d-a362-4d78-9d9c-83b35f8d4716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:28:00.133998 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978982de-c384-47e5-af7e-69845f4fb6c0 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:00.178792 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:00.209749 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 329/659] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:28:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 12:28:00.227684 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83db3d-a362-4d78-9d9c-83b35f8d4716 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:00.283316 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978982de-c384-47e5-af7e-69845f4fb6c0 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:00.335095 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482fb97-43ee-4f77-8673-71cf33edc23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:00.336259 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482fb97-43ee-4f77-8673-71cf33edc23d None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:00.337150 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482fb97-43ee-4f77-8673-71cf33edc23d None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:00.337768 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2482fb97-43ee-4f77-8673-71cf33edc23d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:00.338599 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2482fb97-43ee-4f77-8673-71cf33edc23d None admin] RBAC: Adding query filter params (role.id=af00ed97066e4c72aeb6cd3d5b5d15c9, scope.project.id=e3316e9a169444ac827619608acc9fb7, user.id=36964c4644584d4282b04596ad20717c) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:00.338920 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2482fb97-43ee-4f77-8673-71cf33edc23d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:00.340392 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2482fb97-43ee-4f77-8673-71cf33edc23d None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:00.345322 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83db3d-a362-4d78-9d9c-83b35f8d4716 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:00.358470 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 331/660] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jul 27 12:28:00 2022] GET /identity/v3/role_assignments?user.id=36964c4644584d4282b04596ad20717c&scope.project.id=e3316e9a169444ac827619608acc9fb7&role.id=af00ed97066e4c72aeb6cd3d5b5d15c9 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:28:00.374577 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:00.392198 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddf075-0396-4e34-a3dc-e2e5b70de754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:00.392862 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddf075-0396-4e34-a3dc-e2e5b70de754 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:00.393140 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddf075-0396-4e34-a3dc-e2e5b70de754 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:00.393420 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddf075-0396-4e34-a3dc-e2e5b70de754 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:00.394087 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fddf075-0396-4e34-a3dc-e2e5b70de754 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:00.395539 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fddf075-0396-4e34-a3dc-e2e5b70de754 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:00.408736 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-8fddf075-0396-4e34-a3dc-e2e5b70de754 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 12:28:00.408736 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:00.408736 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 12:28:00.408736 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 12:28:00.408736 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 12:28:00.408736 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 12:28:00.408736 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 12:28:00.408736 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 12:28:00.408736 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 12:28:00.408736 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:28:00.408736 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 12:28:00.408736 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:28:00.408736 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:00.408736 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:28:00.408736 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:28:00.408736 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:28:00.409800 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:28:00.409800 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:28:00.409800 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:28:00.409800 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:28:00.409800 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:28:00.409800 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:28:00.409800 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:28:00.409800 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 12:28:00.409800 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 12:28:00.409800 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 12:28:00.409800 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 12:28:00.409800 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:28:00.409800 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:28:00.409800 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:28:00.409800 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:28:00.409800 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:28:00.410660 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:28:00.410660 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:28:00.410660 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:28:00.410660 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:28:00.410660 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:28:00.410660 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:28:00.410660 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:28:00.410660 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:28:00.410660 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:28:00.410660 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:28:00.410660 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:28:00.410660 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 12:28:00.410660 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 12:28:00.410660 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 12:28:00.410660 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:28:00.415291 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 330/661] 10.222.0.55 () {56 vars in 1129 bytes} [Wed Jul 27 12:28:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 12:28:00.416989 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482fb97-43ee-4f77-8673-71cf33edc23d None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:00.537721 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:00.548007 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2482fb97-43ee-4f77-8673-71cf33edc23d None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:00.586966 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bda226-c3cb-4963-87c0-f5552696fb23 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:00.587255 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bda226-c3cb-4963-87c0-f5552696fb23 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:00.587563 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bda226-c3cb-4963-87c0-f5552696fb23 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:00.589053 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 331/662] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:28:00.591181 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a9ffc-4700-4a0a-85f5-bb9e641da627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:00.591810 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a9ffc-4700-4a0a-85f5-bb9e641da627 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:00.592095 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a9ffc-4700-4a0a-85f5-bb9e641da627 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:00.592509 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a9ffc-4700-4a0a-85f5-bb9e641da627 None admin] PATH_INFO: `/v3/services` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:00.593197 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a9ffc-4700-4a0a-85f5-bb9e641da627 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:00.593504 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a9ffc-4700-4a0a-85f5-bb9e641da627 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:00.595060 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a9ffc-4700-4a0a-85f5-bb9e641da627 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:00.596095 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39e3db-2347-4cf4-8696-6b875f17cd78 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:00.596622 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39e3db-2347-4cf4-8696-6b875f17cd78 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:00.597105 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39e3db-2347-4cf4-8696-6b875f17cd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:00.600566 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 332/663] 10.222.0.55 () {56 vars in 1124 bytes} [Wed Jul 27 12:28:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:28:00.606536 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a9ffc-4700-4a0a-85f5-bb9e641da627 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:00.620370 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-3c39e3db-2347-4cf4-8696-6b875f17cd78 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:28:00.622051 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-3c39e3db-2347-4cf4-8696-6b875f17cd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:28:00.721951 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 332/664] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:28:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 12:28:00.737432 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a9ffc-4700-4a0a-85f5-bb9e641da627 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:00.743826 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39e3db-2347-4cf4-8696-6b875f17cd78 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:00.780839 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fba5d6-d14d-4417-b231-13c5c7e16272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:00.781754 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fba5d6-d14d-4417-b231-13c5c7e16272 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:00.782040 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fba5d6-d14d-4417-b231-13c5c7e16272 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:00.782317 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fba5d6-d14d-4417-b231-13c5c7e16272 None admin] PATH_INFO: `/v3/services` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:00.783389 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fba5d6-d14d-4417-b231-13c5c7e16272 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:00.783699 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fba5d6-d14d-4417-b231-13c5c7e16272 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:00.785333 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fba5d6-d14d-4417-b231-13c5c7e16272 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:00.797719 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 333/665] 10.222.0.55 () {56 vars in 1124 bytes} [Wed Jul 27 12:28:00 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:28:00.877312 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39e3db-2347-4cf4-8696-6b875f17cd78 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:00.894378 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:00.917893 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba43819-29e7-484c-aba0-63a42876d964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:00.918568 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba43819-29e7-484c-aba0-63a42876d964 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:00.918856 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba43819-29e7-484c-aba0-63a42876d964 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:00.919137 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba43819-29e7-484c-aba0-63a42876d964 None admin] PATH_INFO: `/v3/services/network` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:00.919782 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba43819-29e7-484c-aba0-63a42876d964 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:00.921165 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba43819-29e7-484c-aba0-63a42876d964 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:00.931211 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-eba43819-29e7-484c-aba0-63a42876d964 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 12:28:00.931211 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:00.931211 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 12:28:00.931211 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 12:28:00.931211 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 12:28:00.931211 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 12:28:00.931211 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 12:28:00.931211 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 12:28:00.931211 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 12:28:00.931211 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:28:00.931211 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 12:28:00.931211 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:28:00.931211 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:00.931211 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:28:00.931211 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:28:00.931211 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:28:00.931211 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:28:00.932283 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:28:00.932283 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:28:00.932283 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:28:00.932283 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:28:00.932283 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:28:00.932283 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:28:00.932283 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 12:28:00.932283 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 12:28:00.932283 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 12:28:00.932283 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 12:28:00.932283 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:28:00.932283 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:28:00.932283 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:28:00.932283 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:28:00.932283 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:28:00.932283 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:28:00.933552 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:28:00.933552 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:28:00.933552 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:28:00.933552 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:28:00.933552 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:28:00.933552 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:28:00.933552 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:28:00.933552 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:28:00.933552 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:28:00.933552 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:28:00.933552 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 12:28:00.933552 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 12:28:00.933552 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 12:28:00.933552 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:28:00.933552 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 333/666] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jul 27 12:28:00 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:28:00.939197 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fba5d6-d14d-4417-b231-13c5c7e16272 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:00.967003 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:01.054607 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fba5d6-d14d-4417-b231-13c5c7e16272 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:01.089678 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6fa7f0-26e0-42f2-8a61-dbd1dad7c112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:01.090291 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fa7f0-26e0-42f2-8a61-dbd1dad7c112 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:01.090571 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fa7f0-26e0-42f2-8a61-dbd1dad7c112 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:01.090998 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fa7f0-26e0-42f2-8a61-dbd1dad7c112 None admin] PATH_INFO: `/v3/services` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:01.091686 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6fa7f0-26e0-42f2-8a61-dbd1dad7c112 None admin] RBAC: Adding query filter params (name=network) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:01.091988 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6fa7f0-26e0-42f2-8a61-dbd1dad7c112 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:01.093365 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6fa7f0-26e0-42f2-8a61-dbd1dad7c112 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:01.098984 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 334/667] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jul 27 12:28:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:28:01.104450 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba43819-29e7-484c-aba0-63a42876d964 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:01.213154 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba43819-29e7-484c-aba0-63a42876d964 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:01.257621 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4d052-c183-4364-b849-6a11f4b7ea21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:01.257621 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4d052-c183-4364-b849-6a11f4b7ea21 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:01.257621 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4d052-c183-4364-b849-6a11f4b7ea21 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:01.257621 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4d052-c183-4364-b849-6a11f4b7ea21 None admin] PATH_INFO: `/v3/services` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:01.258032 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4d052-c183-4364-b849-6a11f4b7ea21 None admin] RBAC: Adding query filter params (type=network) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:01.258032 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4d052-c183-4364-b849-6a11f4b7ea21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:01.258032 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4d052-c183-4364-b849-6a11f4b7ea21 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:01.263505 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 334/668] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jul 27 12:28:01 2022] GET /identity/v3/services?type=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:28:02.237176 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0986a1-6c68-4c16-8333-9702fc4214dd None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:02.237749 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0986a1-6c68-4c16-8333-9702fc4214dd None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:02.237749 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0986a1-6c68-4c16-8333-9702fc4214dd None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:02.239367 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 335/669] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:28:02.244706 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161b83c-44c5-4b42-8b88-1d87b4ecb2cc None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:02.245104 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161b83c-44c5-4b42-8b88-1d87b4ecb2cc None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:02.245305 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161b83c-44c5-4b42-8b88-1d87b4ecb2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:02.269100 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-0161b83c-44c5-4b42-8b88-1d87b4ecb2cc None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:28:02.270331 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-0161b83c-44c5-4b42-8b88-1d87b4ecb2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:28:02.306973 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:02.339531 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 335/670] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:28:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:28:02.362738 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0986a1-6c68-4c16-8333-9702fc4214dd None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:02.459051 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:02.478166 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0986a1-6c68-4c16-8333-9702fc4214dd None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:02.518536 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda64925-4a65-46fd-a5a9-2f20854a9ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:02.519544 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda64925-4a65-46fd-a5a9-2f20854a9ad1 None admin] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:02.520039 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda64925-4a65-46fd-a5a9-2f20854a9ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:02.520582 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda64925-4a65-46fd-a5a9-2f20854a9ad1 None admin] PATH_INFO: `/v3/services` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:02.521527 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda64925-4a65-46fd-a5a9-2f20854a9ad1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:02.523208 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda64925-4a65-46fd-a5a9-2f20854a9ad1 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:02.540020 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 336/671] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jul 27 12:28:02 2022] POST /identity/v3/services => generated 242 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 12:28:02.651280 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b99c12-6b5a-46f4-b55c-4eb676453894 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:02.651641 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b99c12-6b5a-46f4-b55c-4eb676453894 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:02.651866 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b99c12-6b5a-46f4-b55c-4eb676453894 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:02.653527 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 336/672] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:28:02.659557 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d1284-db9b-4885-8189-9cca311b8988 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:02.660202 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d1284-db9b-4885-8189-9cca311b8988 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:02.660688 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d1284-db9b-4885-8189-9cca311b8988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:02.692869 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-989d1284-db9b-4885-8189-9cca311b8988 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:28:02.694549 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-989d1284-db9b-4885-8189-9cca311b8988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:28:02.775776 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 337/673] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:28:02 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 12:28:02.799326 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b99c12-6b5a-46f4-b55c-4eb676453894 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:02.904122 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b99c12-6b5a-46f4-b55c-4eb676453894 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:02.940147 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8286616-b297-487a-bc72-6bd8b1878eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:02.940780 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8286616-b297-487a-bc72-6bd8b1878eda None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:02.941056 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8286616-b297-487a-bc72-6bd8b1878eda None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:02.941335 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8286616-b297-487a-bc72-6bd8b1878eda None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:02.951839 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8286616-b297-487a-bc72-6bd8b1878eda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:28:02.956733 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-f8286616-b297-487a-bc72-6bd8b1878eda None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 12:28:02.956733 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:02.956733 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:28:02.956733 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:28:02.956733 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:28:02.956733 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:28:02.956733 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:28:02.956733 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:28:02.956733 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:28:02.956733 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:28:02.956733 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:28:02.956733 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:28:02.956733 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:28:02.956733 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:28:02.956733 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:28:02.956733 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:28:02.957708 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:28:02.957708 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:28:02.957708 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:28:02.957708 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:28:02.957708 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:28:02.957708 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:28:02.957708 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:28:02.957708 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:28:02.957708 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:28:02.957708 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:28:02.957708 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:28:02.957708 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:28:02.957708 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:28:02.957708 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:28:02.957708 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:28:02.957708 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:28:02.958556 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:28:02.958556 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:28:02.958556 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:28:02.958556 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:28:02.958556 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:28:02.958556 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:28:02.958556 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:28:02.958556 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:28:02.958556 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:28:02.958556 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:28:02.958556 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 12:28:02.958556 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:28:02.961712 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 337/674] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jul 27 12:28:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:28:02.964341 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d1284-db9b-4885-8189-9cca311b8988 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:03.051588 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:03.076035 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d1284-db9b-4885-8189-9cca311b8988 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:03.111765 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8bb8c-a7f2-4836-9bc3-765018bf5149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:03.112389 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8bb8c-a7f2-4836-9bc3-765018bf5149 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:03.112669 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8bb8c-a7f2-4836-9bc3-765018bf5149 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:03.112941 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8bb8c-a7f2-4836-9bc3-765018bf5149 None admin] PATH_INFO: `/v3/roles` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:03.113681 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8bb8c-a7f2-4836-9bc3-765018bf5149 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:03.113983 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8bb8c-a7f2-4836-9bc3-765018bf5149 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:03.115449 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8bb8c-a7f2-4836-9bc3-765018bf5149 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:03.128871 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 338/675] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:28:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:28:03.130220 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8286616-b297-487a-bc72-6bd8b1878eda None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:03.165956 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:03.169959 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a9ce5-ec7b-4304-8103-3d20c5efcfa3 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:03.170248 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a9ce5-ec7b-4304-8103-3d20c5efcfa3 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:03.170525 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a9ce5-ec7b-4304-8103-3d20c5efcfa3 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:03.172742 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 339/676] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:28:03.178805 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3135fdf-c561-4eac-afdc-dc89193c3edd None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:03.179208 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3135fdf-c561-4eac-afdc-dc89193c3edd None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:03.179584 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3135fdf-c561-4eac-afdc-dc89193c3edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:03.198878 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-f3135fdf-c561-4eac-afdc-dc89193c3edd None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:28:03.200195 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-f3135fdf-c561-4eac-afdc-dc89193c3edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:28:03.244921 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8286616-b297-487a-bc72-6bd8b1878eda None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:03.293968 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 340/677] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:28:03 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 12:28:03.300840 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc034edd-2fd5-44b7-8d52-07203e2ff55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:03.301726 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc034edd-2fd5-44b7-8d52-07203e2ff55d None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:03.302160 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc034edd-2fd5-44b7-8d52-07203e2ff55d None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:03.302646 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc034edd-2fd5-44b7-8d52-07203e2ff55d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:03.313540 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc034edd-2fd5-44b7-8d52-07203e2ff55d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:03.315201 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc034edd-2fd5-44b7-8d52-07203e2ff55d None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:03.318167 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3135fdf-c561-4eac-afdc-dc89193c3edd None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:03.335099 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-bc034edd-2fd5-44b7-8d52-07203e2ff55d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:28:03.335099 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:03.335099 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:28:03.335099 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:28:03.335099 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:28:03.335099 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:28:03.335099 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:28:03.335099 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:28:03.335099 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:28:03.335099 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:28:03.335099 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:28:03.335099 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:28:03.335099 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:28:03.335099 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:28:03.335099 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:28:03.336272 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:28:03.336272 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:28:03.336272 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:28:03.336272 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:28:03.336272 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:28:03.336272 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:28:03.336272 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:28:03.336272 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:28:03.336272 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:28:03.336272 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:28:03.336272 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:28:03.336272 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:28:03.336272 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:28:03.336272 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:28:03.336272 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:28:03.336272 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:28:03.336272 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:28:03.337418 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:28:03.337418 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:28:03.337418 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:28:03.337418 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:28:03.339895 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 338/678] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:28:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:28:03.346515 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc034edd-2fd5-44b7-8d52-07203e2ff55d None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:03.399591 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:03.437453 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:03.455019 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3135fdf-c561-4eac-afdc-dc89193c3edd None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:03.455361 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc034edd-2fd5-44b7-8d52-07203e2ff55d None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:03.495504 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6455a-eaf3-415b-883c-7b47c32c6985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:03.496274 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6455a-eaf3-415b-883c-7b47c32c6985 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:03.496651 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6455a-eaf3-415b-883c-7b47c32c6985 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:03.497022 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6455a-eaf3-415b-883c-7b47c32c6985 None admin] PATH_INFO: `/v3/domains` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:03.497851 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6455a-eaf3-415b-883c-7b47c32c6985 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:03.498255 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6455a-eaf3-415b-883c-7b47c32c6985 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:03.499863 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6455a-eaf3-415b-883c-7b47c32c6985 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:03.504162 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffad59b-ec40-4377-99ce-3c3cd642179b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:03.504975 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffad59b-ec40-4377-99ce-3c3cd642179b None admin] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:03.505404 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffad59b-ec40-4377-99ce-3c3cd642179b None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:03.505923 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffad59b-ec40-4377-99ce-3c3cd642179b None admin] PATH_INFO: `/v3/services` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:03.506761 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffad59b-ec40-4377-99ce-3c3cd642179b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:03.508758 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffad59b-ec40-4377-99ce-3c3cd642179b None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:03.516862 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 339/679] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:28:03.522714 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6455a-eaf3-415b-883c-7b47c32c6985 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:03.525076 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 341/680] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jul 27 12:28:03 2022] POST /identity/v3/services => generated 251 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 12:28:03.627444 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda48ed4-4fd5-450a-a3a4-2927edf34d74 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:03.627771 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda48ed4-4fd5-450a-a3a4-2927edf34d74 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:03.627954 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda48ed4-4fd5-450a-a3a4-2927edf34d74 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:03.629569 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 342/681] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 12:28:03.635044 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b3042-2cf7-473a-9338-a48041de075c None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:03.635336 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b3042-2cf7-473a-9338-a48041de075c None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:03.635622 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b3042-2cf7-473a-9338-a48041de075c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:03.646874 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6455a-eaf3-415b-883c-7b47c32c6985 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:03.655510 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-510b3042-2cf7-473a-9338-a48041de075c None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:28:03.657304 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-510b3042-2cf7-473a-9338-a48041de075c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:28:03.705623 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8abefa-27fe-4d92-8bc7-3b32d21f3ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:03.706293 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8abefa-27fe-4d92-8bc7-3b32d21f3ce2 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:03.706584 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8abefa-27fe-4d92-8bc7-3b32d21f3ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:03.706864 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8abefa-27fe-4d92-8bc7-3b32d21f3ce2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:03.717371 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8abefa-27fe-4d92-8bc7-3b32d21f3ce2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:03.719522 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8abefa-27fe-4d92-8bc7-3b32d21f3ce2 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:03.722499 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:03.733752 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-bc8abefa-27fe-4d92-8bc7-3b32d21f3ce2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 12:28:03.733752 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:03.733752 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:28:03.733752 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:28:03.733752 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:28:03.733752 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:28:03.733752 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:28:03.733752 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:28:03.733752 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:28:03.733752 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:28:03.733752 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:28:03.733752 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:28:03.733752 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 12:28:03.733752 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 12:28:03.733752 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 12:28:03.733752 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 12:28:03.734784 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:28:03.734784 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:28:03.734784 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 12:28:03.734784 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:28:03.734784 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 12:28:03.734784 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:28:03.734784 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:28:03.734784 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:28:03.734784 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:28:03.734784 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:28:03.734784 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:28:03.734784 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:28:03.734784 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:28:03.734784 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:28:03.734784 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:28:03.734784 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:28:03.734784 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:28:03.734784 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:28:03.735732 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:28:03.735732 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:28:03.735732 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 12:28:03.735732 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 12:28:03.735732 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 12:28:03.735732 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 12:28:03.735732 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 12:28:03.735732 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 12:28:03.735732 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 12:28:03.735732 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:28:03.735732 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 340/682] 10.222.0.55 () {56 vars in 1093 bytes} [Wed Jul 27 12:28:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:28:03.740586 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8abefa-27fe-4d92-8bc7-3b32d21f3ce2 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:03.749514 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 343/683] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:28:03 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 12:28:03.780577 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b3042-2cf7-473a-9338-a48041de075c None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:03.848763 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:03.884985 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8abefa-27fe-4d92-8bc7-3b32d21f3ce2 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:03.918324 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b3042-2cf7-473a-9338-a48041de075c None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:03.936766 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ebd45-54a3-4c29-b31e-6a6bd83f6aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:03.938441 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ebd45-54a3-4c29-b31e-6a6bd83f6aed None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:03.939519 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ebd45-54a3-4c29-b31e-6a6bd83f6aed None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:03.939803 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ebd45-54a3-4c29-b31e-6a6bd83f6aed None admin] PATH_INFO: `/v3/users` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:03.940618 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ebd45-54a3-4c29-b31e-6a6bd83f6aed None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:03.940932 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ebd45-54a3-4c29-b31e-6a6bd83f6aed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:03.942435 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ebd45-54a3-4c29-b31e-6a6bd83f6aed None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:03.960627 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050801bc-19e4-492c-8e28-849e4a7a4240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:03.961711 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050801bc-19e4-492c-8e28-849e4a7a4240 None admin] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:03.962212 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050801bc-19e4-492c-8e28-849e4a7a4240 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:03.962711 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050801bc-19e4-492c-8e28-849e4a7a4240 None admin] PATH_INFO: `/v3/services` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:03.963610 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050801bc-19e4-492c-8e28-849e4a7a4240 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:03.965200 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050801bc-19e4-492c-8e28-849e4a7a4240 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:03.966281 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 341/684] 10.222.0.55 () {56 vars in 1133 bytes} [Wed Jul 27 12:28:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:28:03.967424 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ebd45-54a3-4c29-b31e-6a6bd83f6aed None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:03.983106 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 344/685] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jul 27 12:28:03 2022] POST /identity/v3/services => generated 240 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 12:28:04.039821 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:04.089451 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ebd45-54a3-4c29-b31e-6a6bd83f6aed None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:04.134646 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e70394-5be2-4c32-983c-ba1ec42e607d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:04.135727 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e70394-5be2-4c32-983c-ba1ec42e607d None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:04.136214 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e70394-5be2-4c32-983c-ba1ec42e607d None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:04.136691 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e70394-5be2-4c32-983c-ba1ec42e607d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:04.149439 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e70394-5be2-4c32-983c-ba1ec42e607d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:04.151391 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e70394-5be2-4c32-983c-ba1ec42e607d None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:04.168197 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-b3e70394-5be2-4c32-983c-ba1ec42e607d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:28:04.168197 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:04.168197 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:28:04.168197 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:28:04.168197 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:28:04.168197 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:28:04.168197 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:28:04.168197 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:28:04.168197 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:28:04.168197 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:28:04.168197 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:28:04.168197 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:28:04.168197 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:28:04.168197 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:28:04.168197 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:28:04.169156 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:28:04.169156 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:28:04.169156 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:28:04.169156 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:28:04.169156 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:28:04.169156 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:28:04.169156 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:28:04.169156 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:28:04.169156 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:28:04.169156 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:28:04.169156 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:28:04.169156 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:28:04.169156 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:28:04.169156 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:28:04.169156 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:28:04.169156 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:28:04.169156 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:28:04.170096 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:28:04.170096 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:28:04.170096 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:28:04.170096 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:28:04.173010 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 342/686] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:28:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:28:04.178442 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050801bc-19e4-492c-8e28-849e4a7a4240 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:04.293896 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050801bc-19e4-492c-8e28-849e4a7a4240 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:04.307994 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:04.334185 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8cda5-a637-4712-9cd4-0be872cb633a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:04.334818 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8cda5-a637-4712-9cd4-0be872cb633a None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:04.335106 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8cda5-a637-4712-9cd4-0be872cb633a None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:04.335388 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8cda5-a637-4712-9cd4-0be872cb633a None admin] PATH_INFO: `/v3/domains` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:04.336097 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac8cda5-a637-4712-9cd4-0be872cb633a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:04.336407 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac8cda5-a637-4712-9cd4-0be872cb633a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:04.337808 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac8cda5-a637-4712-9cd4-0be872cb633a None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:04.350690 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 345/687] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:28:04.356216 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e70394-5be2-4c32-983c-ba1ec42e607d None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:04.463516 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e70394-5be2-4c32-983c-ba1ec42e607d None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:04.471406 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:04.502381 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f2ddab-3915-40a2-aaa5-471f587b0cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:04.503034 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2ddab-3915-40a2-aaa5-471f587b0cd9 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:04.503321 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2ddab-3915-40a2-aaa5-471f587b0cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:04.503601 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2ddab-3915-40a2-aaa5-471f587b0cd9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:04.510651 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f2ddab-3915-40a2-aaa5-471f587b0cd9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:04.512104 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f2ddab-3915-40a2-aaa5-471f587b0cd9 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:04.524095 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-f3f2ddab-3915-40a2-aaa5-471f587b0cd9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 12:28:04.524095 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:04.524095 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:28:04.524095 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:28:04.524095 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:28:04.524095 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:28:04.524095 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:28:04.524095 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:28:04.524095 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:28:04.524095 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:28:04.524095 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:28:04.524095 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:28:04.524095 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 12:28:04.524095 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 12:28:04.524095 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 12:28:04.525019 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 12:28:04.525019 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:28:04.525019 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:28:04.525019 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:28:04.525019 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:28:04.525019 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:28:04.525019 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:28:04.525019 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:28:04.525019 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:28:04.525019 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:28:04.525019 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:28:04.525019 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:28:04.525019 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:28:04.525019 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:28:04.525019 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:28:04.525019 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:28:04.525019 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:28:04.525961 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 12:28:04.525961 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 12:28:04.525961 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 12:28:04.525961 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 12:28:04.525961 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 12:28:04.525961 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 12:28:04.525961 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 12:28:04.525961 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:28:04.525961 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 343/688] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jul 27 12:28:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:28:04.531815 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8cda5-a637-4712-9cd4-0be872cb633a None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:04.643556 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8cda5-a637-4712-9cd4-0be872cb633a None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:04.681088 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc4db35-39c7-457b-ae21-db77f97b671f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:04.681753 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4db35-39c7-457b-ae21-db77f97b671f None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:04.682040 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4db35-39c7-457b-ae21-db77f97b671f None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:04.682317 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4db35-39c7-457b-ae21-db77f97b671f None admin] PATH_INFO: `/v3/projects` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:04.683077 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc4db35-39c7-457b-ae21-db77f97b671f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:04.683388 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc4db35-39c7-457b-ae21-db77f97b671f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:04.684826 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc4db35-39c7-457b-ae21-db77f97b671f None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:04.698067 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 346/689] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jul 27 12:28:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:28:04.704274 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f2ddab-3915-40a2-aaa5-471f587b0cd9 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:04.818151 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f2ddab-3915-40a2-aaa5-471f587b0cd9 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:04.853133 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db04cc6-71ee-469a-ac6c-c46d8f8c791b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:04.853872 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db04cc6-71ee-469a-ac6c-c46d8f8c791b None admin] REQUEST_METHOD: `PUT` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:04.854159 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db04cc6-71ee-469a-ac6c-c46d8f8c791b None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:04.854440 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db04cc6-71ee-469a-ac6c-c46d8f8c791b None admin] PATH_INFO: `/v3/projects/e3316e9a169444ac827619608acc9fb7/users/36964c4644584d4282b04596ad20717c/roles/af00ed97066e4c72aeb6cd3d5b5d15c9` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:04.856390 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db04cc6-71ee-469a-ac6c-c46d8f8c791b None admin] RBAC: Authorizing `identity:create_grant(project_id=e3316e9a169444ac827619608acc9fb7, user_id=36964c4644584d4282b04596ad20717c, role_id=af00ed97066e4c72aeb6cd3d5b5d15c9)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:04.857883 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db04cc6-71ee-469a-ac6c-c46d8f8c791b None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:04.873625 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 344/690] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jul 27 12:28:04 2022] PUT /identity/v3/projects/e3316e9a169444ac827619608acc9fb7/users/36964c4644584d4282b04596ad20717c/roles/af00ed97066e4c72aeb6cd3d5b5d15c9 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 12:28:04.880182 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089505f-a4a1-4b91-b2f6-fa94d44f4d89 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:04.880488 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089505f-a4a1-4b91-b2f6-fa94d44f4d89 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:04.880755 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089505f-a4a1-4b91-b2f6-fa94d44f4d89 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:04.882638 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 347/691] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:28:04.888466 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e41e5-284b-4cd8-abca-6ae44ba5704c None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:04.888762 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e41e5-284b-4cd8-abca-6ae44ba5704c None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:04.889039 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e41e5-284b-4cd8-abca-6ae44ba5704c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:04.910300 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-406e41e5-284b-4cd8-abca-6ae44ba5704c None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:28:04.911536 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-406e41e5-284b-4cd8-abca-6ae44ba5704c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:28:04.935118 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:04.990835 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 345/692] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:28:04 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 12:28:05.014738 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089505f-a4a1-4b91-b2f6-fa94d44f4d89 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:05.051689 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:05.130632 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089505f-a4a1-4b91-b2f6-fa94d44f4d89 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:05.165608 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d10fc9-fcfd-4561-b767-a2f63bc5c3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:05.166345 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d10fc9-fcfd-4561-b767-a2f63bc5c3b6 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:05.166626 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d10fc9-fcfd-4561-b767-a2f63bc5c3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:05.166901 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d10fc9-fcfd-4561-b767-a2f63bc5c3b6 None admin] PATH_INFO: `/v3/services/image` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:05.167529 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d10fc9-fcfd-4561-b767-a2f63bc5c3b6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:05.169069 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d10fc9-fcfd-4561-b767-a2f63bc5c3b6 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:05.178556 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-63d10fc9-fcfd-4561-b767-a2f63bc5c3b6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 12:28:05.178556 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:05.178556 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 12:28:05.178556 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 12:28:05.178556 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 12:28:05.178556 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 12:28:05.178556 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 12:28:05.178556 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 12:28:05.178556 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 12:28:05.178556 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:28:05.178556 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 12:28:05.178556 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:28:05.178556 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:05.178556 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:28:05.178556 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:28:05.178556 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:28:05.178556 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:28:05.179661 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:28:05.179661 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:28:05.179661 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:28:05.179661 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:28:05.179661 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:28:05.179661 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:28:05.179661 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 12:28:05.179661 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 12:28:05.179661 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 12:28:05.179661 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 12:28:05.179661 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:28:05.179661 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:28:05.179661 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:28:05.179661 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:28:05.179661 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:28:05.179661 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:28:05.180525 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:28:05.180525 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:28:05.180525 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:28:05.180525 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:28:05.180525 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:28:05.180525 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:28:05.180525 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:28:05.180525 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:28:05.180525 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:28:05.180525 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:28:05.180525 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 12:28:05.180525 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 12:28:05.180525 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 12:28:05.180525 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:28:05.180525 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 348/693] 10.222.0.55 () {56 vars in 1105 bytes} [Wed Jul 27 12:28:05 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:28:05.185906 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e41e5-284b-4cd8-abca-6ae44ba5704c None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:05.290930 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e41e5-284b-4cd8-abca-6ae44ba5704c None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:05.332557 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d2da6-251d-483f-8682-5adb9211ae7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:05.333181 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d2da6-251d-483f-8682-5adb9211ae7f None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:05.333467 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d2da6-251d-483f-8682-5adb9211ae7f None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:05.333800 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d2da6-251d-483f-8682-5adb9211ae7f None admin] PATH_INFO: `/v3/services` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:05.334544 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d2da6-251d-483f-8682-5adb9211ae7f None admin] RBAC: Adding query filter params (name=image) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:05.334854 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d2da6-251d-483f-8682-5adb9211ae7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:05.336231 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d2da6-251d-483f-8682-5adb9211ae7f None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:05.341553 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 346/694] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:28:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:28:05.347480 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d10fc9-fcfd-4561-b767-a2f63bc5c3b6 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:05.452422 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:05.463843 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d10fc9-fcfd-4561-b767-a2f63bc5c3b6 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:05.500266 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de862baa-1a42-45e1-a3e8-a27f12fe7e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:05.501257 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de862baa-1a42-45e1-a3e8-a27f12fe7e1f None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:05.501775 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de862baa-1a42-45e1-a3e8-a27f12fe7e1f None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:05.502258 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de862baa-1a42-45e1-a3e8-a27f12fe7e1f None admin] PATH_INFO: `/v3/services` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:05.503139 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de862baa-1a42-45e1-a3e8-a27f12fe7e1f None admin] RBAC: Adding query filter params (type=image) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:05.503641 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de862baa-1a42-45e1-a3e8-a27f12fe7e1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:05.505220 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de862baa-1a42-45e1-a3e8-a27f12fe7e1f None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:05.510856 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 349/695] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:28:05 2022] GET /identity/v3/services?type=image => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:28:05.516915 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d2da6-251d-483f-8682-5adb9211ae7f None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:05.542609 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:05.636621 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d2da6-251d-483f-8682-5adb9211ae7f None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:05.673205 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aee80d-4af1-48fa-91c8-811d101bc8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:05.673856 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aee80d-4af1-48fa-91c8-811d101bc8a9 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:05.674147 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aee80d-4af1-48fa-91c8-811d101bc8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:05.674423 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aee80d-4af1-48fa-91c8-811d101bc8a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:05.675188 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aee80d-4af1-48fa-91c8-811d101bc8a9 None admin] RBAC: Adding query filter params (interface=public, service_id=f167ddf5f3a84bd18d9ecd800ebe1a56, region_id=RegionOne) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:05.675498 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aee80d-4af1-48fa-91c8-811d101bc8a9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:05.676895 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aee80d-4af1-48fa-91c8-811d101bc8a9 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:05.688293 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 347/696] 10.222.0.55 () {56 vars in 1251 bytes} [Wed Jul 27 12:28:05 2022] GET /identity/v3/endpoints?service_id=f167ddf5f3a84bd18d9ecd800ebe1a56&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:28:05.696414 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de862baa-1a42-45e1-a3e8-a27f12fe7e1f None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:05.809706 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de862baa-1a42-45e1-a3e8-a27f12fe7e1f None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:05.845854 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b8b46-73ac-4181-aec0-87d2f0b444ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:05.846668 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b8b46-73ac-4181-aec0-87d2f0b444ad None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:05.846939 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b8b46-73ac-4181-aec0-87d2f0b444ad None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:05.847215 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b8b46-73ac-4181-aec0-87d2f0b444ad None admin] PATH_INFO: `/v3/services` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:05.847873 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b8b46-73ac-4181-aec0-87d2f0b444ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:05.849246 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b8b46-73ac-4181-aec0-87d2f0b444ad None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:05.855767 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 350/697] 10.222.0.55 () {56 vars in 1087 bytes} [Wed Jul 27 12:28:05 2022] GET /identity/v3/services => generated 1002 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 12:28:05.892532 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b54b87-e4a5-48fb-bceb-596f27e94ee4 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:05.892848 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b54b87-e4a5-48fb-bceb-596f27e94ee4 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:05.893101 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b54b87-e4a5-48fb-bceb-596f27e94ee4 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:05.894836 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 348/698] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:28:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:28:05.900656 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae31499-6a94-4251-a0cb-817a25bce4b5 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:05.900960 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae31499-6a94-4251-a0cb-817a25bce4b5 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:05.901222 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae31499-6a94-4251-a0cb-817a25bce4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:05.921698 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-fae31499-6a94-4251-a0cb-817a25bce4b5 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:28:05.922945 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-fae31499-6a94-4251-a0cb-817a25bce4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:28:05.943047 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:06.001758 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 351/699] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:28:05 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 12:28:06.025392 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b54b87-e4a5-48fb-bceb-596f27e94ee4 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:06.119043 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:06.137012 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b54b87-e4a5-48fb-bceb-596f27e94ee4 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:06.173629 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ec75e-b63e-48ee-92b2-9d19a404771b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:06.174327 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ec75e-b63e-48ee-92b2-9d19a404771b None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:06.174614 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ec75e-b63e-48ee-92b2-9d19a404771b None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:06.174900 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ec75e-b63e-48ee-92b2-9d19a404771b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:06.175550 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ec75e-b63e-48ee-92b2-9d19a404771b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:06.176988 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ec75e-b63e-48ee-92b2-9d19a404771b None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:06.186909 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-7c8ec75e-b63e-48ee-92b2-9d19a404771b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 12:28:06.186909 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:06.186909 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 12:28:06.186909 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 12:28:06.186909 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 12:28:06.186909 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 12:28:06.186909 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 12:28:06.186909 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 12:28:06.186909 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 12:28:06.186909 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:28:06.186909 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 12:28:06.186909 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:28:06.186909 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:06.186909 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:28:06.186909 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:28:06.186909 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:28:06.188460 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:28:06.188460 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:28:06.188460 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:28:06.188460 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:28:06.188460 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:28:06.188460 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:28:06.188460 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:28:06.188460 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 12:28:06.188460 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 12:28:06.188460 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 12:28:06.188460 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 12:28:06.188460 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:28:06.188460 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:28:06.188460 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:28:06.188460 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:28:06.188460 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:28:06.189306 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:28:06.189306 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:28:06.189306 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:28:06.189306 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:28:06.189306 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:28:06.189306 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:28:06.189306 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:28:06.189306 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:28:06.189306 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:28:06.189306 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:28:06.189306 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:28:06.189306 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 12:28:06.189306 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 12:28:06.189306 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 12:28:06.189306 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:28:06.189306 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 349/700] 10.222.0.55 () {56 vars in 1129 bytes} [Wed Jul 27 12:28:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:28:06.194897 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae31499-6a94-4251-a0cb-817a25bce4b5 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:06.313815 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae31499-6a94-4251-a0cb-817a25bce4b5 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:06.351314 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e28c5-2857-4bdd-b874-f12f7c6da6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:06.352077 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e28c5-2857-4bdd-b874-f12f7c6da6bc None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:06.352267 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e28c5-2857-4bdd-b874-f12f7c6da6bc None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:06.352478 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e28c5-2857-4bdd-b874-f12f7c6da6bc None admin] PATH_INFO: `/v3/services` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:06.353165 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e28c5-2857-4bdd-b874-f12f7c6da6bc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:06.353472 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e28c5-2857-4bdd-b874-f12f7c6da6bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:06.354885 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e28c5-2857-4bdd-b874-f12f7c6da6bc None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:06.360104 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 352/701] 10.222.0.55 () {56 vars in 1124 bytes} [Wed Jul 27 12:28:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:28:06.365933 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ec75e-b63e-48ee-92b2-9d19a404771b None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:06.452916 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a07c2-327d-4915-8951-871cd5ff9d96 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:06.453162 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a07c2-327d-4915-8951-871cd5ff9d96 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:06.453440 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a07c2-327d-4915-8951-871cd5ff9d96 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:06.454796 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 353/702] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 12:28:06.460742 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29288cd3-cc1b-42f7-9aab-d3e3ffab07c3 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:06.461503 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29288cd3-cc1b-42f7-9aab-d3e3ffab07c3 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:06.462026 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29288cd3-cc1b-42f7-9aab-d3e3ffab07c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:06.473549 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ec75e-b63e-48ee-92b2-9d19a404771b None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:06.485434 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-29288cd3-cc1b-42f7-9aab-d3e3ffab07c3 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:28:06.487635 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-29288cd3-cc1b-42f7-9aab-d3e3ffab07c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:28:06.505394 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:06.517574 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11487ff8-86c9-47b2-80ef-d8d23bf842d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:06.518421 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11487ff8-86c9-47b2-80ef-d8d23bf842d4 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:06.518762 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11487ff8-86c9-47b2-80ef-d8d23bf842d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:06.519273 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11487ff8-86c9-47b2-80ef-d8d23bf842d4 None admin] PATH_INFO: `/v3/services` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:06.519978 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11487ff8-86c9-47b2-80ef-d8d23bf842d4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:06.520313 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11487ff8-86c9-47b2-80ef-d8d23bf842d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:06.522471 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11487ff8-86c9-47b2-80ef-d8d23bf842d4 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:06.533932 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 350/703] 10.222.0.55 () {56 vars in 1124 bytes} [Wed Jul 27 12:28:06 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:28:06.535553 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11487ff8-86c9-47b2-80ef-d8d23bf842d4 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:06.553103 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:06.581648 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 354/704] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:28:06 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 12:28:06.610781 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29288cd3-cc1b-42f7-9aab-d3e3ffab07c3 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:06.662402 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11487ff8-86c9-47b2-80ef-d8d23bf842d4 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:06.700733 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9715e-2a68-4089-85e2-8086b7394215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:06.701464 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9715e-2a68-4089-85e2-8086b7394215 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:06.701960 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9715e-2a68-4089-85e2-8086b7394215 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:06.702341 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9715e-2a68-4089-85e2-8086b7394215 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:06.703419 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b9715e-2a68-4089-85e2-8086b7394215 None admin] RBAC: Adding query filter params (interface=public, service_id=4e962e9ab5eb48cc88f66994c7f9d2e3, region_id=RegionOne) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:06.703791 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b9715e-2a68-4089-85e2-8086b7394215 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:06.705274 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b9715e-2a68-4089-85e2-8086b7394215 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:06.715604 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 351/705] 10.222.0.55 () {56 vars in 1251 bytes} [Wed Jul 27 12:28:06 2022] GET /identity/v3/endpoints?service_id=4e962e9ab5eb48cc88f66994c7f9d2e3&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:28:06.716611 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9715e-2a68-4089-85e2-8086b7394215 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:06.717805 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29288cd3-cc1b-42f7-9aab-d3e3ffab07c3 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:06.755626 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a1770-517c-4790-a48d-0e2f5b1d7ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:06.756305 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a1770-517c-4790-a48d-0e2f5b1d7ca3 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:06.756592 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a1770-517c-4790-a48d-0e2f5b1d7ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:06.756872 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a1770-517c-4790-a48d-0e2f5b1d7ca3 None admin] PATH_INFO: `/v3/services/network` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:06.757506 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a1770-517c-4790-a48d-0e2f5b1d7ca3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:06.758921 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a1770-517c-4790-a48d-0e2f5b1d7ca3 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:06.768942 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-2e2a1770-517c-4790-a48d-0e2f5b1d7ca3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 12:28:06.768942 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:06.768942 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 12:28:06.768942 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 12:28:06.768942 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 12:28:06.768942 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 12:28:06.768942 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 12:28:06.768942 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 12:28:06.768942 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 12:28:06.768942 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:28:06.768942 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 12:28:06.768942 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:28:06.768942 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:06.768942 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:28:06.768942 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:28:06.768942 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:28:06.768942 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:28:06.770070 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:28:06.770070 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:28:06.770070 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:28:06.770070 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:28:06.770070 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:28:06.770070 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:28:06.770070 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 12:28:06.770070 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 12:28:06.770070 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 12:28:06.770070 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 12:28:06.770070 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:28:06.770070 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:28:06.770070 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:28:06.770070 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:28:06.770070 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:28:06.770070 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:28:06.770932 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:28:06.770932 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:28:06.770932 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:28:06.770932 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:28:06.770932 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:28:06.770932 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:28:06.770932 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:28:06.770932 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:28:06.770932 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:28:06.770932 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:28:06.770932 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 12:28:06.770932 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 12:28:06.770932 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 12:28:06.770932 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:28:06.770932 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 355/706] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jul 27 12:28:06 2022] GET /identity/v3/services/network => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 12:28:06.776036 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a1770-517c-4790-a48d-0e2f5b1d7ca3 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:06.797898 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:06.810086 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:06.840777 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9715e-2a68-4089-85e2-8086b7394215 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:06.883207 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97936931-74e0-4de0-97f0-52876ec40d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:06.884377 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97936931-74e0-4de0-97f0-52876ec40d61 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:06.885031 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97936931-74e0-4de0-97f0-52876ec40d61 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:06.885422 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97936931-74e0-4de0-97f0-52876ec40d61 None admin] PATH_INFO: `/v3/services` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:06.886235 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97936931-74e0-4de0-97f0-52876ec40d61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:06.888351 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97936931-74e0-4de0-97f0-52876ec40d61 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:06.894969 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 352/707] 10.222.0.55 () {56 vars in 1087 bytes} [Wed Jul 27 12:28:06 2022] GET /identity/v3/services => generated 1002 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 12:28:06.909366 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a1770-517c-4790-a48d-0e2f5b1d7ca3 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:06.950393 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1521ab98-0668-4007-bda0-f9d931fa1074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:06.951371 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521ab98-0668-4007-bda0-f9d931fa1074 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:06.951814 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521ab98-0668-4007-bda0-f9d931fa1074 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:06.952242 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521ab98-0668-4007-bda0-f9d931fa1074 None admin] PATH_INFO: `/v3/services` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:06.953175 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1521ab98-0668-4007-bda0-f9d931fa1074 None admin] RBAC: Adding query filter params (name=network) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:06.953720 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1521ab98-0668-4007-bda0-f9d931fa1074 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:06.955329 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1521ab98-0668-4007-bda0-f9d931fa1074 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:06.961559 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 356/708] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jul 27 12:28:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:28:06.967564 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97936931-74e0-4de0-97f0-52876ec40d61 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:07.083630 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97936931-74e0-4de0-97f0-52876ec40d61 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:07.120656 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e7f5d-76fe-4ccb-8448-95d572fd91cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:07.121623 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e7f5d-76fe-4ccb-8448-95d572fd91cd None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:07.122059 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e7f5d-76fe-4ccb-8448-95d572fd91cd None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:07.122483 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e7f5d-76fe-4ccb-8448-95d572fd91cd None admin] PATH_INFO: `/v3/services` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:07.123378 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e7f5d-76fe-4ccb-8448-95d572fd91cd None admin] RBAC: Adding query filter params (type=network) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:07.123834 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e7f5d-76fe-4ccb-8448-95d572fd91cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:07.125455 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e7f5d-76fe-4ccb-8448-95d572fd91cd None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:07.131550 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 353/709] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jul 27 12:28:06 2022] GET /identity/v3/services?type=network => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:28:07.138078 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1521ab98-0668-4007-bda0-f9d931fa1074 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:07.225293 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:07.250948 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1521ab98-0668-4007-bda0-f9d931fa1074 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:07.290687 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df0260-5506-4561-9a53-4916e6fa43be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:07.291609 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df0260-5506-4561-9a53-4916e6fa43be None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:07.292040 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df0260-5506-4561-9a53-4916e6fa43be None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:07.292465 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df0260-5506-4561-9a53-4916e6fa43be None admin] PATH_INFO: `/v3/endpoints` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:07.293369 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df0260-5506-4561-9a53-4916e6fa43be None admin] RBAC: Adding query filter params (interface=public, service_id=aa5f6a28bb9c4ab1b9b3ac4b9e9e9025, region_id=RegionOne) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:07.293870 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df0260-5506-4561-9a53-4916e6fa43be None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:07.295618 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407e846-2234-4297-92cc-559a1f88f31c None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:07.295737 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df0260-5506-4561-9a53-4916e6fa43be None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:07.296219 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407e846-2234-4297-92cc-559a1f88f31c None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:07.296697 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407e846-2234-4297-92cc-559a1f88f31c None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:07.298751 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 354/710] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:28:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:28:07.307282 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 357/711] 10.222.0.55 () {56 vars in 1251 bytes} [Wed Jul 27 12:28:07 2022] GET /identity/v3/endpoints?service_id=aa5f6a28bb9c4ab1b9b3ac4b9e9e9025&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:28:07.307444 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912dbdc-bbda-4e0b-9887-c2f95c36846f None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:07.307629 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912dbdc-bbda-4e0b-9887-c2f95c36846f None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:07.311742 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912dbdc-bbda-4e0b-9887-c2f95c36846f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:07.313705 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df0260-5506-4561-9a53-4916e6fa43be None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:07.317516 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:07.328791 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-2912dbdc-bbda-4e0b-9887-c2f95c36846f None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:28:07.330201 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-2912dbdc-bbda-4e0b-9887-c2f95c36846f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:28:07.402568 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 355/712] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:28:07 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 12:28:07.421651 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df0260-5506-4561-9a53-4916e6fa43be None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:07.427158 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912dbdc-bbda-4e0b-9887-c2f95c36846f None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:07.458978 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab114c-484b-4f02-8fc5-9ad703110801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:07.459614 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab114c-484b-4f02-8fc5-9ad703110801 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:07.459898 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab114c-484b-4f02-8fc5-9ad703110801 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:07.460178 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab114c-484b-4f02-8fc5-9ad703110801 None admin] PATH_INFO: `/v3/services` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:07.461013 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ab114c-484b-4f02-8fc5-9ad703110801 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:07.463048 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ab114c-484b-4f02-8fc5-9ad703110801 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:07.469349 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 358/713] 10.222.0.55 () {56 vars in 1087 bytes} [Wed Jul 27 12:28:07 2022] GET /identity/v3/services => generated 1002 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 12:28:07.546742 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912dbdc-bbda-4e0b-9887-c2f95c36846f None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:07.584996 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d69690-38fe-4d74-a0be-1d34decd65a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:07.585701 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d69690-38fe-4d74-a0be-1d34decd65a1 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:07.585988 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d69690-38fe-4d74-a0be-1d34decd65a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:07.586267 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d69690-38fe-4d74-a0be-1d34decd65a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:07.588522 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:07.600045 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d69690-38fe-4d74-a0be-1d34decd65a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:28:07.606647 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-53d69690-38fe-4d74-a0be-1d34decd65a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 12:28:07.606647 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:07.606647 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:28:07.606647 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:28:07.606647 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:28:07.606647 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:28:07.606647 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:28:07.606647 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:28:07.606647 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:28:07.606647 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:28:07.606647 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:28:07.606647 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:28:07.606647 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:28:07.606647 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:28:07.606647 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:28:07.606647 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:28:07.607628 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:28:07.607628 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:28:07.607628 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:28:07.607628 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:28:07.607628 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:28:07.607628 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:28:07.607628 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:28:07.607628 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:28:07.607628 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:28:07.607628 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:28:07.607628 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:28:07.607628 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:28:07.607628 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:28:07.607628 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:28:07.607628 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:28:07.607628 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:28:07.608988 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:28:07.608988 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:28:07.608988 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:28:07.608988 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:28:07.608988 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:28:07.608988 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:28:07.608988 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:28:07.608988 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:28:07.608988 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:28:07.608988 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:28:07.608988 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 12:28:07.608988 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:28:07.608988 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 356/714] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jul 27 12:28:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 12:28:07.618236 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab114c-484b-4f02-8fc5-9ad703110801 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:07.622431 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:07.740378 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab114c-484b-4f02-8fc5-9ad703110801 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:07.777856 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25100a5e-8dae-40f0-9507-b63ff0c89130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:07.778479 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25100a5e-8dae-40f0-9507-b63ff0c89130 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:07.778759 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25100a5e-8dae-40f0-9507-b63ff0c89130 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:07.779094 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25100a5e-8dae-40f0-9507-b63ff0c89130 None admin] PATH_INFO: `/v3/roles` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:07.779808 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25100a5e-8dae-40f0-9507-b63ff0c89130 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:07.780110 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25100a5e-8dae-40f0-9507-b63ff0c89130 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:07.781509 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25100a5e-8dae-40f0-9507-b63ff0c89130 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:07.790418 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 359/715] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:28:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:28:07.795902 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d69690-38fe-4d74-a0be-1d34decd65a1 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:07.901481 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d69690-38fe-4d74-a0be-1d34decd65a1 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:07.938382 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41aa0a-06c2-4bcc-9fa5-cfe3a14dcea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:07.939073 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41aa0a-06c2-4bcc-9fa5-cfe3a14dcea8 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:07.939351 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41aa0a-06c2-4bcc-9fa5-cfe3a14dcea8 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:07.939621 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41aa0a-06c2-4bcc-9fa5-cfe3a14dcea8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:07.950542 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c41aa0a-06c2-4bcc-9fa5-cfe3a14dcea8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:07.951996 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c41aa0a-06c2-4bcc-9fa5-cfe3a14dcea8 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:07.966998 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-5c41aa0a-06c2-4bcc-9fa5-cfe3a14dcea8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:28:07.966998 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:07.966998 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:28:07.966998 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:28:07.966998 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:28:07.966998 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:28:07.966998 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:28:07.966998 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:28:07.966998 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:28:07.966998 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:28:07.966998 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:28:07.966998 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:28:07.966998 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:28:07.966998 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:28:07.966998 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:28:07.967897 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:28:07.967897 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:28:07.967897 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:28:07.967897 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:28:07.967897 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:28:07.967897 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:28:07.967897 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:28:07.967897 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:28:07.967897 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:28:07.967897 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:28:07.967897 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:28:07.967897 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:28:07.967897 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:28:07.967897 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:28:07.967897 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:28:07.967897 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:28:07.967897 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:28:07.969277 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:28:07.969277 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:28:07.969277 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:28:07.969277 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:28:07.969277 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 357/716] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:28:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:28:07.974051 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25100a5e-8dae-40f0-9507-b63ff0c89130 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:08.041956 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:08.080812 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25100a5e-8dae-40f0-9507-b63ff0c89130 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:08.118971 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884811b0-8b18-41af-ac00-cb307e7a123c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:08.119598 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884811b0-8b18-41af-ac00-cb307e7a123c None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:08.119875 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884811b0-8b18-41af-ac00-cb307e7a123c None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:08.120145 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884811b0-8b18-41af-ac00-cb307e7a123c None admin] PATH_INFO: `/v3/domains` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:08.120836 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884811b0-8b18-41af-ac00-cb307e7a123c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:08.121134 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884811b0-8b18-41af-ac00-cb307e7a123c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:08.122553 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884811b0-8b18-41af-ac00-cb307e7a123c None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:08.135596 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 360/717] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:28:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:28:08.141009 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41aa0a-06c2-4bcc-9fa5-cfe3a14dcea8 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:08.191067 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:08.230299 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c65fad-363d-4015-9a78-8f3e07ead0a0 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:08.230617 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c65fad-363d-4015-9a78-8f3e07ead0a0 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:08.230856 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c65fad-363d-4015-9a78-8f3e07ead0a0 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:08.232476 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 361/718] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 12:28:08.237786 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09190f7-9211-450b-b281-86567c5fbb6f None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:08.238077 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09190f7-9211-450b-b281-86567c5fbb6f None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:08.238362 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09190f7-9211-450b-b281-86567c5fbb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:08.248138 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41aa0a-06c2-4bcc-9fa5-cfe3a14dcea8 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:08.257704 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-e09190f7-9211-450b-b281-86567c5fbb6f None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:28:08.259021 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-e09190f7-9211-450b-b281-86567c5fbb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:28:08.291126 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325554d-112f-42d6-9e5e-b7e044a6f5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:08.291776 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325554d-112f-42d6-9e5e-b7e044a6f5b9 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:08.292056 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325554d-112f-42d6-9e5e-b7e044a6f5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:08.292329 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325554d-112f-42d6-9e5e-b7e044a6f5b9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:08.302872 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325554d-112f-42d6-9e5e-b7e044a6f5b9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:08.304509 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325554d-112f-42d6-9e5e-b7e044a6f5b9 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:08.319313 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-1325554d-112f-42d6-9e5e-b7e044a6f5b9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 12:28:08.319313 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:08.319313 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:28:08.319313 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:28:08.319313 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:28:08.319313 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:28:08.319313 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:28:08.319313 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:28:08.319313 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:28:08.319313 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:28:08.319313 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:28:08.319313 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:28:08.319313 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 12:28:08.319313 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 12:28:08.319313 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 12:28:08.319313 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 12:28:08.321393 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:28:08.321393 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:28:08.321393 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 12:28:08.321393 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:28:08.321393 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 12:28:08.321393 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:28:08.321393 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:28:08.321393 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:28:08.321393 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:28:08.321393 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:28:08.321393 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:28:08.321393 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:28:08.321393 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:28:08.321393 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:28:08.321393 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:28:08.321393 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:28:08.321393 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:28:08.321393 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:28:08.322688 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:28:08.322688 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:28:08.322688 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 12:28:08.322688 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 12:28:08.322688 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 12:28:08.322688 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 12:28:08.322688 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 12:28:08.322688 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 12:28:08.322688 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 12:28:08.322688 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:28:08.322688 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 358/719] 10.222.0.55 () {56 vars in 1093 bytes} [Wed Jul 27 12:28:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:28:08.326398 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325554d-112f-42d6-9e5e-b7e044a6f5b9 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:08.349737 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 362/720] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:28:08 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 12:28:08.369770 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09190f7-9211-450b-b281-86567c5fbb6f None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:08.429951 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:08.448579 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325554d-112f-42d6-9e5e-b7e044a6f5b9 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:08.457352 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:08.483332 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09190f7-9211-450b-b281-86567c5fbb6f None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:08.502448 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ba06a-4ec4-43da-8a61-6d39655e5c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:08.503076 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ba06a-4ec4-43da-8a61-6d39655e5c78 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:08.503358 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ba06a-4ec4-43da-8a61-6d39655e5c78 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:08.503633 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ba06a-4ec4-43da-8a61-6d39655e5c78 None admin] PATH_INFO: `/v3/users` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:08.504425 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ba06a-4ec4-43da-8a61-6d39655e5c78 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:08.504729 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ba06a-4ec4-43da-8a61-6d39655e5c78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:08.506969 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ba06a-4ec4-43da-8a61-6d39655e5c78 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:08.519865 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983e6d4-a59d-48ca-919f-f867de2891c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:08.520519 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983e6d4-a59d-48ca-919f-f867de2891c1 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:08.520803 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983e6d4-a59d-48ca-919f-f867de2891c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:08.521083 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983e6d4-a59d-48ca-919f-f867de2891c1 None admin] PATH_INFO: `/v3/services/image` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:08.521760 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d983e6d4-a59d-48ca-919f-f867de2891c1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:08.523157 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d983e6d4-a59d-48ca-919f-f867de2891c1 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:08.533029 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-d983e6d4-a59d-48ca-919f-f867de2891c1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 12:28:08.533029 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:08.533029 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 12:28:08.533029 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 12:28:08.533029 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 12:28:08.533029 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 12:28:08.533029 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 12:28:08.533029 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 12:28:08.533029 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 12:28:08.533029 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:28:08.533029 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 12:28:08.533029 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:28:08.533029 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:08.533029 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:28:08.533029 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:28:08.533029 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:28:08.533029 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:28:08.535539 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:28:08.535539 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:28:08.535539 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:28:08.535539 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:28:08.535539 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:28:08.535539 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:28:08.535539 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 12:28:08.535539 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 12:28:08.535539 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 12:28:08.535539 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 12:28:08.535539 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:28:08.535539 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:28:08.535539 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:28:08.535539 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:28:08.535539 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:28:08.535539 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:28:08.537537 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:28:08.537537 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:28:08.537537 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:28:08.537537 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:28:08.537537 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:28:08.537537 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:28:08.537537 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:28:08.537537 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:28:08.537537 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:28:08.537537 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:28:08.537537 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 12:28:08.537537 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 12:28:08.537537 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 12:28:08.537537 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:28:08.540840 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 359/721] 10.222.0.55 () {56 vars in 1133 bytes} [Wed Jul 27 12:28:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:28:08.540840 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ba06a-4ec4-43da-8a61-6d39655e5c78 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:08.541025 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 363/722] 10.222.0.55 () {56 vars in 1105 bytes} [Wed Jul 27 12:28:08 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 12:28:08.541025 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983e6d4-a59d-48ca-919f-f867de2891c1 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:08.649080 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983e6d4-a59d-48ca-919f-f867de2891c1 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:08.668181 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ba06a-4ec4-43da-8a61-6d39655e5c78 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:08.675993 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:08.701724 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57b8c6-e692-45d3-b9dd-558996168026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:08.701724 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57b8c6-e692-45d3-b9dd-558996168026 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:08.701724 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57b8c6-e692-45d3-b9dd-558996168026 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:08.701724 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57b8c6-e692-45d3-b9dd-558996168026 None admin] PATH_INFO: `/v3/services` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:08.702221 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce57b8c6-e692-45d3-b9dd-558996168026 None admin] RBAC: Adding query filter params (name=image) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:08.702221 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce57b8c6-e692-45d3-b9dd-558996168026 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:08.702221 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce57b8c6-e692-45d3-b9dd-558996168026 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:08.707447 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944b724-cdb3-4391-8bc1-8f6527ec1106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:08.708065 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944b724-cdb3-4391-8bc1-8f6527ec1106 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:08.708642 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944b724-cdb3-4391-8bc1-8f6527ec1106 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:08.708804 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 364/723] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:28:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:28:08.708910 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944b724-cdb3-4391-8bc1-8f6527ec1106 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:08.709751 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57b8c6-e692-45d3-b9dd-558996168026 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:08.741420 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:08.781182 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944b724-cdb3-4391-8bc1-8f6527ec1106 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:08.782716 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944b724-cdb3-4391-8bc1-8f6527ec1106 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:08.826670 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57b8c6-e692-45d3-b9dd-558996168026 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:08.864453 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab628a1-6be6-40d2-b085-b60b27d378a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:08.865494 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab628a1-6be6-40d2-b085-b60b27d378a8 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:08.865950 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab628a1-6be6-40d2-b085-b60b27d378a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:08.866668 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab628a1-6be6-40d2-b085-b60b27d378a8 None admin] PATH_INFO: `/v3/services` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:08.867790 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab628a1-6be6-40d2-b085-b60b27d378a8 None admin] RBAC: Adding query filter params (type=image) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:08.868265 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab628a1-6be6-40d2-b085-b60b27d378a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:08.869895 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab628a1-6be6-40d2-b085-b60b27d378a8 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:08.880915 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 365/724] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:28:08 2022] GET /identity/v3/services?type=image => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:28:08.882110 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab628a1-6be6-40d2-b085-b60b27d378a8 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:08.889807 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 360/725] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jul 27 12:28:08 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 12:28:08.890885 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944b724-cdb3-4391-8bc1-8f6527ec1106 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:08.940291 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:08.954984 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:08.997070 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944b724-cdb3-4391-8bc1-8f6527ec1106 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:09.003415 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab628a1-6be6-40d2-b085-b60b27d378a8 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:09.033879 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08ba66-eb0f-4075-87c9-f5f712204edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:09.034518 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08ba66-eb0f-4075-87c9-f5f712204edb None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:09.034799 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08ba66-eb0f-4075-87c9-f5f712204edb None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:09.035179 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08ba66-eb0f-4075-87c9-f5f712204edb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:09.041200 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297422f-4f9d-4790-ac3b-29825bcc2d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:09.042120 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297422f-4f9d-4790-ac3b-29825bcc2d64 None admin] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:09.042553 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297422f-4f9d-4790-ac3b-29825bcc2d64 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:09.042999 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297422f-4f9d-4790-ac3b-29825bcc2d64 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:09.043915 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8297422f-4f9d-4790-ac3b-29825bcc2d64 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:09.045247 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d08ba66-eb0f-4075-87c9-f5f712204edb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:09.045771 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8297422f-4f9d-4790-ac3b-29825bcc2d64 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:09.046690 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d08ba66-eb0f-4075-87c9-f5f712204edb None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:09.063833 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-1d08ba66-eb0f-4075-87c9-f5f712204edb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:28:09.063833 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:09.063833 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:28:09.063833 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:28:09.063833 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:28:09.063833 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:28:09.063833 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:28:09.063833 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:28:09.063833 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:28:09.063833 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:28:09.063833 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:28:09.063833 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:28:09.063833 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:28:09.063833 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:28:09.063833 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:28:09.064869 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:28:09.064869 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:28:09.064869 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:28:09.064869 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:28:09.064869 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:28:09.064869 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:28:09.064869 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:28:09.064869 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:28:09.064869 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:28:09.064869 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:28:09.064869 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:28:09.064869 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:28:09.064869 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:28:09.064869 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:28:09.064869 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:28:09.064869 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:28:09.064869 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:28:09.065913 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:28:09.065913 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:28:09.065913 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:28:09.065913 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:28:09.070167 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 361/726] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:28:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 12:28:09.071375 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08ba66-eb0f-4075-87c9-f5f712204edb None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:09.085884 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 366/727] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Jul 27 12:28:08 2022] POST /identity/v3/endpoints => generated 327 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 12:28:09.190351 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08ba66-eb0f-4075-87c9-f5f712204edb None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:09.214825 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:09.236519 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44648693-c1da-4e30-8b2b-474b24149eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:09.237145 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44648693-c1da-4e30-8b2b-474b24149eea None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:09.237422 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44648693-c1da-4e30-8b2b-474b24149eea None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:09.237726 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44648693-c1da-4e30-8b2b-474b24149eea None admin] PATH_INFO: `/v3/domains` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:09.238425 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44648693-c1da-4e30-8b2b-474b24149eea None admin] RBAC: Adding query filter params (name=Default) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:09.238732 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44648693-c1da-4e30-8b2b-474b24149eea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:09.240135 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44648693-c1da-4e30-8b2b-474b24149eea None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:09.251271 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2951cb4-72cc-41e7-ac9d-833895d7fc1a None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:09.251559 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2951cb4-72cc-41e7-ac9d-833895d7fc1a None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:09.251845 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2951cb4-72cc-41e7-ac9d-833895d7fc1a None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:09.254731 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 362/729] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:28:09.254870 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 367/729] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 12:28:09.260323 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2951cb4-72cc-41e7-ac9d-833895d7fc1a None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:09.261086 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e9b55-47c8-4e17-a0b9-2737b0f7b50a None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:09.261422 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e9b55-47c8-4e17-a0b9-2737b0f7b50a None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:09.261762 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e9b55-47c8-4e17-a0b9-2737b0f7b50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:09.281937 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-187e9b55-47c8-4e17-a0b9-2737b0f7b50a None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:28:09.283116 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-187e9b55-47c8-4e17-a0b9-2737b0f7b50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:28:09.372496 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 363/730] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:28:09 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 12:28:09.394748 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e9b55-47c8-4e17-a0b9-2737b0f7b50a None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:09.399350 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2951cb4-72cc-41e7-ac9d-833895d7fc1a None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:09.402642 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:09.438400 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbde2a3-ec8b-444d-822c-d72369432004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:09.439065 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbde2a3-ec8b-444d-822c-d72369432004 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:09.439313 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbde2a3-ec8b-444d-822c-d72369432004 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:09.439572 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbde2a3-ec8b-444d-822c-d72369432004 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:09.446568 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbde2a3-ec8b-444d-822c-d72369432004 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:09.448005 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbde2a3-ec8b-444d-822c-d72369432004 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:09.460828 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-acbde2a3-ec8b-444d-822c-d72369432004 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 12:28:09.460828 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:09.460828 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:28:09.460828 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:28:09.460828 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:28:09.460828 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:28:09.460828 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:28:09.460828 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:28:09.460828 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:28:09.460828 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:28:09.460828 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:28:09.460828 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:28:09.460828 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 12:28:09.460828 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 12:28:09.460828 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 12:28:09.461792 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 12:28:09.461792 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:28:09.461792 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:28:09.461792 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:28:09.461792 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:28:09.461792 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:28:09.461792 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:28:09.461792 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:28:09.461792 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:28:09.461792 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:28:09.461792 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:28:09.461792 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:28:09.461792 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:28:09.461792 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:28:09.461792 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:28:09.461792 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:28:09.461792 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:28:09.463310 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 12:28:09.463310 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 12:28:09.463310 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 12:28:09.463310 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 12:28:09.463310 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 12:28:09.463310 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 12:28:09.463310 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 12:28:09.463310 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:28:09.463310 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 368/731] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jul 27 12:28:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:28:09.467657 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbde2a3-ec8b-444d-822c-d72369432004 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:09.526860 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e9b55-47c8-4e17-a0b9-2737b0f7b50a None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:09.564783 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:09.570707 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56c79c-23f7-4bab-a4d4-c7722357e2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:09.571362 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56c79c-23f7-4bab-a4d4-c7722357e2c5 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:09.571689 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56c79c-23f7-4bab-a4d4-c7722357e2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:09.571968 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56c79c-23f7-4bab-a4d4-c7722357e2c5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:09.572874 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db56c79c-23f7-4bab-a4d4-c7722357e2c5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:09.574401 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db56c79c-23f7-4bab-a4d4-c7722357e2c5 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:09.585247 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-db56c79c-23f7-4bab-a4d4-c7722357e2c5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 12:28:09.585247 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:09.585247 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 12:28:09.585247 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 12:28:09.585247 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 12:28:09.585247 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 12:28:09.585247 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 12:28:09.585247 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 12:28:09.585247 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 12:28:09.585247 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:28:09.585247 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 12:28:09.585247 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:28:09.585247 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:09.585247 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:28:09.585247 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:28:09.585247 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:28:09.586239 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:28:09.586239 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:28:09.586239 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:28:09.586239 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:28:09.586239 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:28:09.586239 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:28:09.586239 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:28:09.586239 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 12:28:09.586239 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 12:28:09.586239 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 12:28:09.586239 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 12:28:09.586239 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:28:09.586239 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:28:09.586239 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:28:09.586239 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:28:09.586239 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:28:09.587533 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:28:09.587533 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:28:09.587533 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:28:09.587533 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:28:09.587533 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:28:09.587533 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:28:09.587533 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:28:09.587533 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:28:09.587533 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:28:09.587533 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:28:09.587533 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:28:09.587533 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 12:28:09.587533 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 12:28:09.587533 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 12:28:09.587533 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:28:09.587533 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 364/732] 10.222.0.55 () {56 vars in 1129 bytes} [Wed Jul 27 12:28:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:28:09.592676 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56c79c-23f7-4bab-a4d4-c7722357e2c5 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:09.595791 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbde2a3-ec8b-444d-822c-d72369432004 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:09.633181 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d1260-4781-4ddf-b5df-9f3d9d0bafac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:09.633857 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d1260-4781-4ddf-b5df-9f3d9d0bafac None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:09.634148 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d1260-4781-4ddf-b5df-9f3d9d0bafac None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:09.634412 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d1260-4781-4ddf-b5df-9f3d9d0bafac None admin] PATH_INFO: `/v3/projects` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:09.635186 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d1260-4781-4ddf-b5df-9f3d9d0bafac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:09.635499 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d1260-4781-4ddf-b5df-9f3d9d0bafac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:09.637092 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d1260-4781-4ddf-b5df-9f3d9d0bafac None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:09.652716 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 369/733] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jul 27 12:28:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:28:09.660412 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d1260-4781-4ddf-b5df-9f3d9d0bafac None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:09.698391 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:09.730506 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56c79c-23f7-4bab-a4d4-c7722357e2c5 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:09.768953 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc5f38-4be5-46db-876e-f486fcb81f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:09.769706 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc5f38-4be5-46db-876e-f486fcb81f0f None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:09.769993 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc5f38-4be5-46db-876e-f486fcb81f0f None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:09.770265 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc5f38-4be5-46db-876e-f486fcb81f0f None admin] PATH_INFO: `/v3/services` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:09.770991 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc5f38-4be5-46db-876e-f486fcb81f0f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:09.771297 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc5f38-4be5-46db-876e-f486fcb81f0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:09.772662 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc5f38-4be5-46db-876e-f486fcb81f0f None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:09.784544 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 365/734] 10.222.0.55 () {56 vars in 1124 bytes} [Wed Jul 27 12:28:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:28:09.785987 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc5f38-4be5-46db-876e-f486fcb81f0f None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:09.813311 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d1260-4781-4ddf-b5df-9f3d9d0bafac None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:09.820178 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:09.853202 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f225a29-dd88-4f2c-a833-790561dcd689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:09.854075 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f225a29-dd88-4f2c-a833-790561dcd689 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:09.854445 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f225a29-dd88-4f2c-a833-790561dcd689 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:09.854626 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f225a29-dd88-4f2c-a833-790561dcd689 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:09.855410 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f225a29-dd88-4f2c-a833-790561dcd689 None admin] RBAC: Adding query filter params (role.id=af00ed97066e4c72aeb6cd3d5b5d15c9, scope.project.id=e3316e9a169444ac827619608acc9fb7, user.id=36964c4644584d4282b04596ad20717c) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:09.855721 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f225a29-dd88-4f2c-a833-790561dcd689 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:09.857148 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f225a29-dd88-4f2c-a833-790561dcd689 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:09.869630 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 370/735] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jul 27 12:28:09 2022] GET /identity/v3/role_assignments?user.id=36964c4644584d4282b04596ad20717c&scope.project.id=e3316e9a169444ac827619608acc9fb7&role.id=af00ed97066e4c72aeb6cd3d5b5d15c9 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:28:09.869630 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043cbf8e-7da4-45f3-af81-1b1e97a0897a None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:09.869630 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043cbf8e-7da4-45f3-af81-1b1e97a0897a None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:09.869630 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043cbf8e-7da4-45f3-af81-1b1e97a0897a None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:09.869630 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 371/736] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:28:09.873697 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240f5ac-7af8-45a1-bbde-72408e388b2b None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:09.873697 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240f5ac-7af8-45a1-bbde-72408e388b2b None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:09.873697 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240f5ac-7af8-45a1-bbde-72408e388b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:09.892876 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-3240f5ac-7af8-45a1-bbde-72408e388b2b None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:28:09.894149 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-3240f5ac-7af8-45a1-bbde-72408e388b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:28:09.905372 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc5f38-4be5-46db-876e-f486fcb81f0f None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:09.943834 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecd65f-9801-4174-ae5f-7635fa3364a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:09.944523 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecd65f-9801-4174-ae5f-7635fa3364a7 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:09.944815 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecd65f-9801-4174-ae5f-7635fa3364a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:09.945094 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecd65f-9801-4174-ae5f-7635fa3364a7 None admin] PATH_INFO: `/v3/services` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:09.946469 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ecd65f-9801-4174-ae5f-7635fa3364a7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:09.947042 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ecd65f-9801-4174-ae5f-7635fa3364a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:09.948579 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ecd65f-9801-4174-ae5f-7635fa3364a7 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:09.963738 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 366/737] 10.222.0.55 () {56 vars in 1124 bytes} [Wed Jul 27 12:28:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:28:09.964719 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecd65f-9801-4174-ae5f-7635fa3364a7 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:09.985315 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 372/738] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:28:09 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 12:28:10.010821 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240f5ac-7af8-45a1-bbde-72408e388b2b None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:10.031764 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:10.092513 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:10.104075 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecd65f-9801-4174-ae5f-7635fa3364a7 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:10.138982 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240f5ac-7af8-45a1-bbde-72408e388b2b None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:10.146225 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31042884-5ca3-42af-afac-e15369777d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:10.147086 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31042884-5ca3-42af-afac-e15369777d1e None admin] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:10.147556 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31042884-5ca3-42af-afac-e15369777d1e None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:10.148438 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31042884-5ca3-42af-afac-e15369777d1e None admin] PATH_INFO: `/v3/endpoints` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:10.149354 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31042884-5ca3-42af-afac-e15369777d1e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:10.151333 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31042884-5ca3-42af-afac-e15369777d1e None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:10.177515 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 367/739] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Jul 27 12:28:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 12:28:10.184883 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2086b3-635d-4a9a-b237-529ca93bdf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:10.185541 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2086b3-635d-4a9a-b237-529ca93bdf3e None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:10.185862 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2086b3-635d-4a9a-b237-529ca93bdf3e None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:10.186132 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2086b3-635d-4a9a-b237-529ca93bdf3e None admin] PATH_INFO: `/v3/services/network` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:10.186870 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2086b3-635d-4a9a-b237-529ca93bdf3e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:10.188930 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2086b3-635d-4a9a-b237-529ca93bdf3e None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:10.199156 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-6b2086b3-635d-4a9a-b237-529ca93bdf3e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 12:28:10.199156 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:10.199156 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 12:28:10.199156 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 12:28:10.199156 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 12:28:10.199156 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 12:28:10.199156 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 12:28:10.199156 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 12:28:10.199156 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 12:28:10.199156 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:28:10.199156 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 12:28:10.199156 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:28:10.199156 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:10.199156 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:28:10.199156 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:28:10.199156 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:28:10.199156 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:28:10.200229 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:28:10.200229 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:28:10.200229 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:28:10.200229 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:28:10.200229 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:28:10.200229 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:28:10.200229 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 12:28:10.200229 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 12:28:10.200229 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 12:28:10.200229 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 12:28:10.200229 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:28:10.200229 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:28:10.200229 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:28:10.200229 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:28:10.200229 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:28:10.200229 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:28:10.201159 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:28:10.201159 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:28:10.201159 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:28:10.201159 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:28:10.201159 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:28:10.201159 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:28:10.201159 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:28:10.201159 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:28:10.201159 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:28:10.201159 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:28:10.201159 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 12:28:10.201159 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 12:28:10.201159 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 12:28:10.201159 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:28:10.201159 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 373/740] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jul 27 12:28:10 2022] GET /identity/v3/services/network => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 12:28:10.206907 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31042884-5ca3-42af-afac-e15369777d1e None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:10.322384 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31042884-5ca3-42af-afac-e15369777d1e None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:10.360274 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897cf215-d624-445f-97ee-34683e3d5cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:10.360907 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897cf215-d624-445f-97ee-34683e3d5cdb None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:10.361186 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897cf215-d624-445f-97ee-34683e3d5cdb None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:10.361459 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897cf215-d624-445f-97ee-34683e3d5cdb None admin] PATH_INFO: `/v3/services` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:10.363140 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897cf215-d624-445f-97ee-34683e3d5cdb None admin] RBAC: Adding query filter params (name=network) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:10.363140 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897cf215-d624-445f-97ee-34683e3d5cdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:10.363824 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897cf215-d624-445f-97ee-34683e3d5cdb None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:10.369703 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 368/741] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jul 27 12:28:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:28:10.377056 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2086b3-635d-4a9a-b237-529ca93bdf3e None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:10.460309 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:10.483510 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2086b3-635d-4a9a-b237-529ca93bdf3e None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:10.519059 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e8290-1040-453f-89f1-a62ba6453e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:10.519676 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e8290-1040-453f-89f1-a62ba6453e04 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:10.519955 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e8290-1040-453f-89f1-a62ba6453e04 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:10.520227 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e8290-1040-453f-89f1-a62ba6453e04 None admin] PATH_INFO: `/v3/services` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:10.520902 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136e8290-1040-453f-89f1-a62ba6453e04 None admin] RBAC: Adding query filter params (type=network) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:10.521199 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136e8290-1040-453f-89f1-a62ba6453e04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:10.522588 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136e8290-1040-453f-89f1-a62ba6453e04 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:10.527886 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 374/742] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jul 27 12:28:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:28:10.534622 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897cf215-d624-445f-97ee-34683e3d5cdb None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:10.552948 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:10.642322 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897cf215-d624-445f-97ee-34683e3d5cdb None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:10.684055 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84214ae6-893b-4d39-96e8-e9401ff1997d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:10.685454 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84214ae6-893b-4d39-96e8-e9401ff1997d None admin] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:10.685976 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84214ae6-893b-4d39-96e8-e9401ff1997d None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:10.686455 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84214ae6-893b-4d39-96e8-e9401ff1997d None admin] PATH_INFO: `/v3/endpoints` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:10.687505 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84214ae6-893b-4d39-96e8-e9401ff1997d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:10.689088 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84214ae6-893b-4d39-96e8-e9401ff1997d None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:10.711210 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 369/743] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Jul 27 12:28:10 2022] POST /identity/v3/endpoints => generated 327 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 12:28:11.467014 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8a278-1b97-44b8-aab6-f2653ee9ec83 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:11.467538 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8a278-1b97-44b8-aab6-f2653ee9ec83 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:11.467538 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8a278-1b97-44b8-aab6-f2653ee9ec83 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:11.469099 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 375/744] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:28:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:28:11.474213 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1274797-84db-4c5c-a890-754aa4aec35f None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:11.474592 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1274797-84db-4c5c-a890-754aa4aec35f None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:11.474775 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1274797-84db-4c5c-a890-754aa4aec35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:11.493073 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-e1274797-84db-4c5c-a890-754aa4aec35f None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:28:11.494279 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-e1274797-84db-4c5c-a890-754aa4aec35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:28:11.557094 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:11.569227 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 370/745] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:28:11 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 12:28:11.592515 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8a278-1b97-44b8-aab6-f2653ee9ec83 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:11.696623 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8a278-1b97-44b8-aab6-f2653ee9ec83 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:11.730354 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204f69f-8008-4948-9901-6e83575fcd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:11.730902 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204f69f-8008-4948-9901-6e83575fcd95 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:11.731183 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204f69f-8008-4948-9901-6e83575fcd95 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:11.731453 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204f69f-8008-4948-9901-6e83575fcd95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:11.744234 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:11.801030 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204f69f-8008-4948-9901-6e83575fcd95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:11.802509 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204f69f-8008-4948-9901-6e83575fcd95 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:11.902787 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 376/746] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jul 27 12:28:11 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 12:28:11.908786 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1274797-84db-4c5c-a890-754aa4aec35f None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:12.019532 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1274797-84db-4c5c-a890-754aa4aec35f None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:12.054347 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7afc8-6d66-4e1f-927b-bbe71b93036c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:12.054991 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7afc8-6d66-4e1f-927b-bbe71b93036c None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:12.055273 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7afc8-6d66-4e1f-927b-bbe71b93036c None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:12.055549 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7afc8-6d66-4e1f-927b-bbe71b93036c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:12.065723 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7afc8-6d66-4e1f-927b-bbe71b93036c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:12.067179 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7afc8-6d66-4e1f-927b-bbe71b93036c None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:12.081827 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-9cc7afc8-6d66-4e1f-927b-bbe71b93036c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:28:12.081827 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:12.081827 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:28:12.081827 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:28:12.081827 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:28:12.081827 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:28:12.081827 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:28:12.081827 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:28:12.081827 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:28:12.081827 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:28:12.081827 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:28:12.081827 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:28:12.081827 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:28:12.081827 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:28:12.081827 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:28:12.082729 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:28:12.082729 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:28:12.082729 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:28:12.082729 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:28:12.082729 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:28:12.082729 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:28:12.082729 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:28:12.082729 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:28:12.082729 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:28:12.082729 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:28:12.082729 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:28:12.082729 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:28:12.082729 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:28:12.082729 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:28:12.082729 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:28:12.082729 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:28:12.082729 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:28:12.088300 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:28:12.088300 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:28:12.088300 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:28:12.088300 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:28:12.088300 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 371/747] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:28:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:28:12.090483 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204f69f-8008-4948-9901-6e83575fcd95 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:12.135309 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:12.198116 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204f69f-8008-4948-9901-6e83575fcd95 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:12.231869 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f24a8be-3467-45e1-966d-ed3e949ba161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:12.232439 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24a8be-3467-45e1-966d-ed3e949ba161 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:12.232835 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24a8be-3467-45e1-966d-ed3e949ba161 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:12.233123 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24a8be-3467-45e1-966d-ed3e949ba161 None admin] PATH_INFO: `/v3/domains` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:12.237210 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f24a8be-3467-45e1-966d-ed3e949ba161 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:12.237210 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f24a8be-3467-45e1-966d-ed3e949ba161 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:12.237210 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f24a8be-3467-45e1-966d-ed3e949ba161 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:12.249162 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 377/748] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:28:12.314201 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1d8b1-97d1-4ea3-a161-4577d467fe48 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:12.314848 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1d8b1-97d1-4ea3-a161-4577d467fe48 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:12.315382 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1d8b1-97d1-4ea3-a161-4577d467fe48 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:12.325212 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 372/749] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:28:12 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:28:12.331261 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01ae4a-1d47-4ceb-9709-2a21c29c2ea6 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:12.331554 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01ae4a-1d47-4ceb-9709-2a21c29c2ea6 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:12.331829 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01ae4a-1d47-4ceb-9709-2a21c29c2ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:12.351473 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-ef01ae4a-1d47-4ceb-9709-2a21c29c2ea6 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:28:12.352735 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-ef01ae4a-1d47-4ceb-9709-2a21c29c2ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:28:12.433737 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 378/750] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:28:12 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 12:28:12.456036 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1d8b1-97d1-4ea3-a161-4577d467fe48 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:12.509530 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:12.523433 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012cda4-3f98-4edb-a6f3-158045b27422 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:12.523921 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012cda4-3f98-4edb-a6f3-158045b27422 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:12.524031 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012cda4-3f98-4edb-a6f3-158045b27422 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:12.525460 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 379/751] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:28:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 12:28:12.530250 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd05240-636c-455b-90a0-7710df8993c4 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:12.530537 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd05240-636c-455b-90a0-7710df8993c4 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:12.530820 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd05240-636c-455b-90a0-7710df8993c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:12.551442 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-4cd05240-636c-455b-90a0-7710df8993c4 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:28:12.552647 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-4cd05240-636c-455b-90a0-7710df8993c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:28:12.566976 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1d8b1-97d1-4ea3-a161-4577d467fe48 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:12.585332 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:12.602585 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b1f4af-888b-424c-ba87-4a6cc75f385e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:12.603255 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1f4af-888b-424c-ba87-4a6cc75f385e None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:12.603546 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1f4af-888b-424c-ba87-4a6cc75f385e None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:12.603828 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1f4af-888b-424c-ba87-4a6cc75f385e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:12.604454 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b1f4af-888b-424c-ba87-4a6cc75f385e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:12.605871 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b1f4af-888b-424c-ba87-4a6cc75f385e None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:12.615181 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-b2b1f4af-888b-424c-ba87-4a6cc75f385e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 12:28:12.615181 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:12.615181 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 12:28:12.615181 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 12:28:12.615181 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 12:28:12.615181 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 12:28:12.615181 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 12:28:12.615181 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 12:28:12.615181 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 12:28:12.615181 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:28:12.615181 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 12:28:12.615181 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:28:12.615181 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:12.615181 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:28:12.615181 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:28:12.615181 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:28:12.616401 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:28:12.616401 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:28:12.616401 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:28:12.616401 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:28:12.616401 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:28:12.616401 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:28:12.616401 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:28:12.616401 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 12:28:12.616401 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 12:28:12.616401 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 12:28:12.616401 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 12:28:12.616401 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:28:12.616401 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:28:12.616401 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:28:12.616401 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:28:12.616401 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:28:12.617292 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:28:12.617292 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:28:12.617292 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:28:12.617292 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:28:12.617292 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:28:12.617292 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:28:12.617292 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:28:12.617292 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:28:12.617292 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:28:12.617292 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:28:12.617292 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:28:12.617292 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 12:28:12.617292 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 12:28:12.617292 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 12:28:12.617292 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:28:12.617292 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 373/752] 10.222.0.55 () {56 vars in 1132 bytes} [Wed Jul 27 12:28:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:28:12.622524 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b1f4af-888b-424c-ba87-4a6cc75f385e None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:12.628419 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 380/753] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:28:12 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 12:28:12.651128 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd05240-636c-455b-90a0-7710df8993c4 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:12.751605 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b1f4af-888b-424c-ba87-4a6cc75f385e None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:12.763066 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd05240-636c-455b-90a0-7710df8993c4 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:12.764279 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:12.786310 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e90bc0-f9f1-4cb9-8822-adf3dc9ca619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:12.786951 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e90bc0-f9f1-4cb9-8822-adf3dc9ca619 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:12.787234 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e90bc0-f9f1-4cb9-8822-adf3dc9ca619 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:12.787509 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e90bc0-f9f1-4cb9-8822-adf3dc9ca619 None admin] PATH_INFO: `/v3/services` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:12.788186 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e90bc0-f9f1-4cb9-8822-adf3dc9ca619 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:12.788490 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e90bc0-f9f1-4cb9-8822-adf3dc9ca619 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:12.789875 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e90bc0-f9f1-4cb9-8822-adf3dc9ca619 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:12.794248 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 374/754] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Jul 27 12:28:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:28:12.797464 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6f208-7cc5-4c84-b4e9-90de0be9c522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:12.798133 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6f208-7cc5-4c84-b4e9-90de0be9c522 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:12.798416 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6f208-7cc5-4c84-b4e9-90de0be9c522 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:12.798689 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6f208-7cc5-4c84-b4e9-90de0be9c522 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:12.799315 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc6f208-7cc5-4c84-b4e9-90de0be9c522 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:12.800573 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e90bc0-f9f1-4cb9-8822-adf3dc9ca619 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:12.800672 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc6f208-7cc5-4c84-b4e9-90de0be9c522 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:12.809519 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-7fc6f208-7cc5-4c84-b4e9-90de0be9c522 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 12:28:12.809519 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:12.809519 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 12:28:12.809519 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 12:28:12.809519 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 12:28:12.809519 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 12:28:12.809519 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 12:28:12.809519 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 12:28:12.809519 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 12:28:12.809519 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:28:12.809519 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 12:28:12.809519 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:28:12.809519 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:12.809519 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:28:12.809519 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:28:12.809519 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:28:12.809519 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:28:12.810727 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:28:12.810727 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:28:12.810727 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:28:12.810727 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:28:12.810727 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:28:12.810727 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:28:12.810727 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 12:28:12.810727 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 12:28:12.810727 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 12:28:12.810727 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 12:28:12.810727 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:28:12.810727 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:28:12.810727 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:28:12.810727 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:28:12.810727 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:28:12.810727 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:28:12.811583 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:28:12.811583 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:28:12.811583 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:28:12.811583 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:28:12.811583 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:28:12.811583 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:28:12.811583 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:28:12.811583 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:28:12.811583 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:28:12.811583 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:28:12.811583 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 12:28:12.811583 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 12:28:12.811583 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 12:28:12.811583 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:28:12.811583 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 381/755] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jul 27 12:28:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 12:28:12.816243 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6f208-7cc5-4c84-b4e9-90de0be9c522 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:12.847821 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:12.899325 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e90bc0-f9f1-4cb9-8822-adf3dc9ca619 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:12.919185 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6f208-7cc5-4c84-b4e9-90de0be9c522 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:12.933097 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8d7ea-cf95-447c-95f1-2d32f4e9a54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:12.933743 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8d7ea-cf95-447c-95f1-2d32f4e9a54a None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:12.934033 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8d7ea-cf95-447c-95f1-2d32f4e9a54a None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:12.934310 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8d7ea-cf95-447c-95f1-2d32f4e9a54a None admin] PATH_INFO: `/v3/services` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:12.934983 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8d7ea-cf95-447c-95f1-2d32f4e9a54a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:12.935293 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8d7ea-cf95-447c-95f1-2d32f4e9a54a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:12.936640 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8d7ea-cf95-447c-95f1-2d32f4e9a54a None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:12.941121 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 375/756] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Jul 27 12:28:12 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:28:12.952851 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4acc6-65dd-42cc-adf8-45e68ccb270a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:12.953502 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4acc6-65dd-42cc-adf8-45e68ccb270a None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:12.953821 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4acc6-65dd-42cc-adf8-45e68ccb270a None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:12.954103 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4acc6-65dd-42cc-adf8-45e68ccb270a None admin] PATH_INFO: `/v3/services` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:12.954813 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4acc6-65dd-42cc-adf8-45e68ccb270a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:12.955124 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4acc6-65dd-42cc-adf8-45e68ccb270a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:12.956534 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4acc6-65dd-42cc-adf8-45e68ccb270a None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:12.961924 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 382/757] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jul 27 12:28:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:28:12.971008 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8d7ea-cf95-447c-95f1-2d32f4e9a54a None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:13.018245 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:13.087119 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8d7ea-cf95-447c-95f1-2d32f4e9a54a None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:13.132140 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391957d-b16b-4578-b0b3-506a7bce90ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:13.132694 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391957d-b16b-4578-b0b3-506a7bce90ae None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:13.132979 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391957d-b16b-4578-b0b3-506a7bce90ae None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:13.133287 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391957d-b16b-4578-b0b3-506a7bce90ae None admin] PATH_INFO: `/v3/services` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:13.134006 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9391957d-b16b-4578-b0b3-506a7bce90ae None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:13.134315 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9391957d-b16b-4578-b0b3-506a7bce90ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:13.135700 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9391957d-b16b-4578-b0b3-506a7bce90ae None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:13.140386 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 376/758] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jul 27 12:28:12 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:28:15.146410 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4b411-1605-439e-a37c-2ca935dc2e86 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:15.146938 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4b411-1605-439e-a37c-2ca935dc2e86 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:15.146938 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4b411-1605-439e-a37c-2ca935dc2e86 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:15.148288 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 383/759] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:28:15.153513 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04715aeb-83ac-4a3a-80b8-12fc2a214c48 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:15.153950 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04715aeb-83ac-4a3a-80b8-12fc2a214c48 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:15.154115 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04715aeb-83ac-4a3a-80b8-12fc2a214c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:15.174934 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-04715aeb-83ac-4a3a-80b8-12fc2a214c48 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:28:15.176179 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-04715aeb-83ac-4a3a-80b8-12fc2a214c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:28:15.247664 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 377/760] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:28:15 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 12:28:15.272640 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4b411-1605-439e-a37c-2ca935dc2e86 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:15.331838 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb19049-deed-4004-b84e-2d687a8d3afd None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:15.332122 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb19049-deed-4004-b84e-2d687a8d3afd None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:15.332399 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb19049-deed-4004-b84e-2d687a8d3afd None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:15.333756 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 378/761] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 12:28:15.338484 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bceb3-71e1-4504-9fd3-8291ff21edd3 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:15.338767 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bceb3-71e1-4504-9fd3-8291ff21edd3 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:15.339045 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bceb3-71e1-4504-9fd3-8291ff21edd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:15.356426 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-9c9bceb3-71e1-4504-9fd3-8291ff21edd3 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:28:15.357629 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-9c9bceb3-71e1-4504-9fd3-8291ff21edd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:28:15.368013 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:15.379584 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4b411-1605-439e-a37c-2ca935dc2e86 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:15.385167 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:15.412430 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391db409-0e45-4591-8441-b5c783f77836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:15.412974 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391db409-0e45-4591-8441-b5c783f77836 None admin] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:15.413253 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391db409-0e45-4591-8441-b5c783f77836 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:15.413525 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391db409-0e45-4591-8441-b5c783f77836 None admin] PATH_INFO: `/v3/services` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:15.414338 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391db409-0e45-4591-8441-b5c783f77836 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:15.415690 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391db409-0e45-4591-8441-b5c783f77836 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:15.428303 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 379/762] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:28:15 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 12:28:15.429785 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 384/763] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jul 27 12:28:15 2022] POST /identity/v3/services => generated 269 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 12:28:15.452536 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bceb3-71e1-4504-9fd3-8291ff21edd3 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:15.556608 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bceb3-71e1-4504-9fd3-8291ff21edd3 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:15.597979 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b6f62-fe2c-4ac6-b59c-af4424f3c57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:15.598628 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b6f62-fe2c-4ac6-b59c-af4424f3c57f None admin] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:15.598913 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b6f62-fe2c-4ac6-b59c-af4424f3c57f None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:15.599236 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b6f62-fe2c-4ac6-b59c-af4424f3c57f None admin] PATH_INFO: `/v3/services` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:15.600161 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b6f62-fe2c-4ac6-b59c-af4424f3c57f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:15.601561 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b6f62-fe2c-4ac6-b59c-af4424f3c57f None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:15.617488 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 380/764] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jul 27 12:28:15 2022] POST /identity/v3/services => generated 251 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 12:28:17.633740 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605f13f-a9a3-4b4a-8d2e-17c3b3077c17 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:17.634286 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605f13f-a9a3-4b4a-8d2e-17c3b3077c17 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:17.634286 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605f13f-a9a3-4b4a-8d2e-17c3b3077c17 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:17.635620 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 385/765] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:28:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:28:17.641299 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545d6cc-b1be-4227-9df9-7ea678f996aa None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:17.641716 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545d6cc-b1be-4227-9df9-7ea678f996aa None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:17.642000 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545d6cc-b1be-4227-9df9-7ea678f996aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:17.660279 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-4545d6cc-b1be-4227-9df9-7ea678f996aa None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:28:17.661451 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-4545d6cc-b1be-4227-9df9-7ea678f996aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:28:17.676091 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:17.739203 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 381/766] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:28:17 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 12:28:17.762764 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605f13f-a9a3-4b4a-8d2e-17c3b3077c17 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:17.852830 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1c17d-c35b-4c81-962c-c083d377bbc4 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:17.853119 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1c17d-c35b-4c81-962c-c083d377bbc4 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:17.853397 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1c17d-c35b-4c81-962c-c083d377bbc4 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:17.854774 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 382/767] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:28:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 12:28:17.859593 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29637ed-e772-437d-afc5-717c34c4875a None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:17.859879 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29637ed-e772-437d-afc5-717c34c4875a None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:17.860157 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29637ed-e772-437d-afc5-717c34c4875a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:17.863628 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605f13f-a9a3-4b4a-8d2e-17c3b3077c17 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:17.878041 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-a29637ed-e772-437d-afc5-717c34c4875a None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:28:17.879219 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-a29637ed-e772-437d-afc5-717c34c4875a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:28:17.900429 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909c8d1-9b71-408b-8f64-c94a26770b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:17.901012 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909c8d1-9b71-408b-8f64-c94a26770b50 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:17.901294 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909c8d1-9b71-408b-8f64-c94a26770b50 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:17.901571 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909c8d1-9b71-408b-8f64-c94a26770b50 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:17.902233 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b909c8d1-9b71-408b-8f64-c94a26770b50 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:17.903598 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b909c8d1-9b71-408b-8f64-c94a26770b50 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:17.912888 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-b909c8d1-9b71-408b-8f64-c94a26770b50 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 12:28:17.912888 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:17.912888 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 12:28:17.912888 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 12:28:17.912888 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 12:28:17.912888 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 12:28:17.912888 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 12:28:17.912888 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 12:28:17.912888 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 12:28:17.912888 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:28:17.912888 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 12:28:17.912888 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:28:17.912888 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:17.912888 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:28:17.912888 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:28:17.912888 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:28:17.913897 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:28:17.913897 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:28:17.913897 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:28:17.913897 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:28:17.913897 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:28:17.913897 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:28:17.913897 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:28:17.913897 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 12:28:17.913897 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 12:28:17.913897 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 12:28:17.913897 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 12:28:17.913897 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:28:17.913897 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:28:17.913897 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:28:17.913897 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:28:17.913897 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:28:17.915081 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:28:17.915081 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:28:17.915081 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:28:17.915081 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:28:17.915081 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:28:17.915081 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:28:17.915081 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:28:17.915081 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:28:17.915081 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:28:17.915081 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:28:17.915081 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:28:17.915081 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 12:28:17.915081 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 12:28:17.915081 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 12:28:17.915081 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:28:17.915081 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 386/768] 10.222.0.55 () {56 vars in 1132 bytes} [Wed Jul 27 12:28:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:28:17.919837 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909c8d1-9b71-408b-8f64-c94a26770b50 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:17.934919 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:17.948581 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 383/769] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:28:17 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 12:28:17.972902 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29637ed-e772-437d-afc5-717c34c4875a None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:18.025644 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909c8d1-9b71-408b-8f64-c94a26770b50 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:18.047856 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:18.060514 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58cfc5-4fc9-437f-869a-e8e5af5504d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:18.061133 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58cfc5-4fc9-437f-869a-e8e5af5504d4 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:18.061413 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58cfc5-4fc9-437f-869a-e8e5af5504d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:18.061725 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58cfc5-4fc9-437f-869a-e8e5af5504d4 None admin] PATH_INFO: `/v3/services` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:18.062925 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e58cfc5-4fc9-437f-869a-e8e5af5504d4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:18.063232 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e58cfc5-4fc9-437f-869a-e8e5af5504d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:18.064599 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e58cfc5-4fc9-437f-869a-e8e5af5504d4 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:18.069190 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 387/770] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Jul 27 12:28:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:28:18.072212 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29637ed-e772-437d-afc5-717c34c4875a None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:18.075567 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58cfc5-4fc9-437f-869a-e8e5af5504d4 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:18.106122 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd6a44f-989c-4ebf-a9a7-ccc47013cc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:18.106855 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6a44f-989c-4ebf-a9a7-ccc47013cc74 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:18.107208 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6a44f-989c-4ebf-a9a7-ccc47013cc74 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:18.107556 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6a44f-989c-4ebf-a9a7-ccc47013cc74 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:18.108258 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd6a44f-989c-4ebf-a9a7-ccc47013cc74 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:18.109703 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd6a44f-989c-4ebf-a9a7-ccc47013cc74 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:18.118713 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-ddd6a44f-989c-4ebf-a9a7-ccc47013cc74 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 12:28:18.118713 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:18.118713 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 12:28:18.118713 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 12:28:18.118713 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 12:28:18.118713 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 12:28:18.118713 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 12:28:18.118713 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 12:28:18.118713 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 12:28:18.118713 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:28:18.118713 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 12:28:18.118713 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:28:18.118713 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:18.118713 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:28:18.118713 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:28:18.118713 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:28:18.118713 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:28:18.119667 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:28:18.119667 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:28:18.119667 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:28:18.119667 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:28:18.119667 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:28:18.119667 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:28:18.119667 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 12:28:18.119667 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 12:28:18.119667 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 12:28:18.119667 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 12:28:18.119667 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:28:18.119667 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:28:18.119667 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:28:18.119667 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:28:18.119667 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:28:18.119667 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:28:18.120787 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:28:18.120787 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:28:18.120787 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:28:18.120787 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:28:18.120787 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:28:18.120787 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:28:18.120787 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:28:18.120787 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:28:18.120787 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:28:18.120787 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:28:18.120787 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 12:28:18.120787 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 12:28:18.120787 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 12:28:18.120787 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:28:18.120787 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 384/771] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jul 27 12:28:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 12:28:18.126173 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd6a44f-989c-4ebf-a9a7-ccc47013cc74 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:18.154267 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:18.175142 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58cfc5-4fc9-437f-869a-e8e5af5504d4 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:18.209188 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d65c60-7b62-4bce-aaf4-6cbb3e8053f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:18.209848 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d65c60-7b62-4bce-aaf4-6cbb3e8053f8 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:18.210132 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d65c60-7b62-4bce-aaf4-6cbb3e8053f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:18.210407 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d65c60-7b62-4bce-aaf4-6cbb3e8053f8 None admin] PATH_INFO: `/v3/services` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:18.211080 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d65c60-7b62-4bce-aaf4-6cbb3e8053f8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:18.211383 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d65c60-7b62-4bce-aaf4-6cbb3e8053f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:18.212748 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d65c60-7b62-4bce-aaf4-6cbb3e8053f8 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:18.217681 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 388/772] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Jul 27 12:28:18 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:28:18.223237 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d65c60-7b62-4bce-aaf4-6cbb3e8053f8 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:18.228488 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd6a44f-989c-4ebf-a9a7-ccc47013cc74 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:18.261652 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621dc773-db7f-47cc-aa13-ab75b6fde640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:18.262480 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621dc773-db7f-47cc-aa13-ab75b6fde640 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:18.262758 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621dc773-db7f-47cc-aa13-ab75b6fde640 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:18.263033 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621dc773-db7f-47cc-aa13-ab75b6fde640 None admin] PATH_INFO: `/v3/services` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:18.263704 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621dc773-db7f-47cc-aa13-ab75b6fde640 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:18.264006 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621dc773-db7f-47cc-aa13-ab75b6fde640 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:18.265973 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621dc773-db7f-47cc-aa13-ab75b6fde640 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:18.270567 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 385/773] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jul 27 12:28:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:28:18.276093 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621dc773-db7f-47cc-aa13-ab75b6fde640 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:18.279884 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:18.326861 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d65c60-7b62-4bce-aaf4-6cbb3e8053f8 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:18.361371 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ed1ab-199a-4fe0-ba3c-da284c50c56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:18.362025 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ed1ab-199a-4fe0-ba3c-da284c50c56a None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:18.362315 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ed1ab-199a-4fe0-ba3c-da284c50c56a None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:18.362600 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ed1ab-199a-4fe0-ba3c-da284c50c56a None admin] PATH_INFO: `/v3/endpoints` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:18.363356 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ed1ab-199a-4fe0-ba3c-da284c50c56a None admin] RBAC: Adding query filter params (interface=public, service_id=44bf23cea2e54155bd2a5bee280a29aa, region_id=RegionOne) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:18.363667 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ed1ab-199a-4fe0-ba3c-da284c50c56a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:18.365030 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ed1ab-199a-4fe0-ba3c-da284c50c56a None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:18.370379 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 389/774] 10.222.0.55 () {56 vars in 1251 bytes} [Wed Jul 27 12:28:18 2022] GET /identity/v3/endpoints?service_id=44bf23cea2e54155bd2a5bee280a29aa&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:28:18.374259 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621dc773-db7f-47cc-aa13-ab75b6fde640 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:18.376318 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ed1ab-199a-4fe0-ba3c-da284c50c56a None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:18.384239 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:18.408476 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d9ae8c-79ce-4158-9d14-fb832a234d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:18.409031 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9ae8c-79ce-4158-9d14-fb832a234d56 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:18.409316 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9ae8c-79ce-4158-9d14-fb832a234d56 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:18.409587 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9ae8c-79ce-4158-9d14-fb832a234d56 None admin] PATH_INFO: `/v3/services` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:18.410291 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d9ae8c-79ce-4158-9d14-fb832a234d56 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:18.410596 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d9ae8c-79ce-4158-9d14-fb832a234d56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:18.411944 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d9ae8c-79ce-4158-9d14-fb832a234d56 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:18.416628 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 386/775] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jul 27 12:28:18 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:28:18.422930 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d9ae8c-79ce-4158-9d14-fb832a234d56 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:18.474828 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ed1ab-199a-4fe0-ba3c-da284c50c56a None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:18.488150 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:18.508780 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824f2e5-00a7-4613-b7a2-a6584fdab6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:18.509413 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824f2e5-00a7-4613-b7a2-a6584fdab6b0 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:18.509716 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824f2e5-00a7-4613-b7a2-a6584fdab6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:18.510003 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824f2e5-00a7-4613-b7a2-a6584fdab6b0 None admin] PATH_INFO: `/v3/services` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:18.510657 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5824f2e5-00a7-4613-b7a2-a6584fdab6b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:18.512026 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5824f2e5-00a7-4613-b7a2-a6584fdab6b0 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:18.517859 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 390/776] 10.222.0.55 () {56 vars in 1087 bytes} [Wed Jul 27 12:28:18 2022] GET /identity/v3/services => generated 1498 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 12:28:18.521544 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d9ae8c-79ce-4158-9d14-fb832a234d56 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:18.558340 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1619f0-50a6-4c22-ae9d-a6cbd323a2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:18.559001 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1619f0-50a6-4c22-ae9d-a6cbd323a2e3 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:18.559289 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1619f0-50a6-4c22-ae9d-a6cbd323a2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:18.559565 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1619f0-50a6-4c22-ae9d-a6cbd323a2e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:18.560332 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1619f0-50a6-4c22-ae9d-a6cbd323a2e3 None admin] RBAC: Adding query filter params (interface=public, service_id=4436d6a293e944638034318c2fc63c21, region_id=RegionOne) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:18.560645 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1619f0-50a6-4c22-ae9d-a6cbd323a2e3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:18.562060 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1619f0-50a6-4c22-ae9d-a6cbd323a2e3 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:18.568385 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 387/777] 10.222.0.55 () {56 vars in 1251 bytes} [Wed Jul 27 12:28:18 2022] GET /identity/v3/endpoints?service_id=4436d6a293e944638034318c2fc63c21&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:28:18.574105 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824f2e5-00a7-4613-b7a2-a6584fdab6b0 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:18.646777 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:18.680698 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824f2e5-00a7-4613-b7a2-a6584fdab6b0 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:18.716352 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99422c5d-dcfb-42fe-a613-c982baee537d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:18.716985 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99422c5d-dcfb-42fe-a613-c982baee537d None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:18.717269 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99422c5d-dcfb-42fe-a613-c982baee537d None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:18.717544 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99422c5d-dcfb-42fe-a613-c982baee537d None admin] PATH_INFO: `/v3/services` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:18.718272 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99422c5d-dcfb-42fe-a613-c982baee537d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:18.719643 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99422c5d-dcfb-42fe-a613-c982baee537d None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:18.725476 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 391/778] 10.222.0.55 () {56 vars in 1087 bytes} [Wed Jul 27 12:28:18 2022] GET /identity/v3/services => generated 1498 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 12:28:20.742292 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeac9d8-f401-4e07-9e83-6c3b865a3ddc None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:20.742911 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeac9d8-f401-4e07-9e83-6c3b865a3ddc None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:20.743021 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeac9d8-f401-4e07-9e83-6c3b865a3ddc None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:20.744284 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 388/779] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:28:20.749475 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535d538-1335-4c3c-a004-1640d5e0aa3c None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:20.749964 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535d538-1335-4c3c-a004-1640d5e0aa3c None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:20.750119 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535d538-1335-4c3c-a004-1640d5e0aa3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:20.768481 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-f535d538-1335-4c3c-a004-1640d5e0aa3c None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:28:20.769732 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-f535d538-1335-4c3c-a004-1640d5e0aa3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:28:20.838703 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 392/780] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:28:20 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 12:28:20.862436 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeac9d8-f401-4e07-9e83-6c3b865a3ddc None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:20.962694 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeac9d8-f401-4e07-9e83-6c3b865a3ddc None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:20.971424 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593f255-ffc7-4806-8d1a-5108cc2ebe9d None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:20.971719 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593f255-ffc7-4806-8d1a-5108cc2ebe9d None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:20.972004 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593f255-ffc7-4806-8d1a-5108cc2ebe9d None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:20.973504 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 393/781] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 12:28:20.978323 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bee514-0009-44d9-9ad9-7b6b1469d660 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:20.978612 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bee514-0009-44d9-9ad9-7b6b1469d660 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:20.978892 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bee514-0009-44d9-9ad9-7b6b1469d660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:20.992782 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:20.997175 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-34bee514-0009-44d9-9ad9-7b6b1469d660 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:28:20.997883 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958d403-2890-4b0d-9500-1f3c576bce5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:20.998396 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-34bee514-0009-44d9-9ad9-7b6b1469d660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:28:20.998526 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958d403-2890-4b0d-9500-1f3c576bce5f None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:20.998810 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958d403-2890-4b0d-9500-1f3c576bce5f None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:20.999085 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958d403-2890-4b0d-9500-1f3c576bce5f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:21.000252 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6958d403-2890-4b0d-9500-1f3c576bce5f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:21.001617 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6958d403-2890-4b0d-9500-1f3c576bce5f None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:21.010450 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-6958d403-2890-4b0d-9500-1f3c576bce5f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 12:28:21.010450 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:21.010450 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 12:28:21.010450 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 12:28:21.010450 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 12:28:21.010450 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 12:28:21.010450 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 12:28:21.010450 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 12:28:21.010450 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 12:28:21.010450 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:28:21.010450 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 12:28:21.010450 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:28:21.010450 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:21.010450 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:28:21.010450 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:28:21.010450 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:28:21.011476 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:28:21.011476 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:28:21.011476 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:28:21.011476 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:28:21.011476 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:28:21.011476 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:28:21.011476 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:28:21.011476 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 12:28:21.011476 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 12:28:21.011476 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 12:28:21.011476 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 12:28:21.011476 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:28:21.011476 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:28:21.011476 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:28:21.011476 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:28:21.011476 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:28:21.012488 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:28:21.012488 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:28:21.012488 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:28:21.012488 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:28:21.012488 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:28:21.012488 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:28:21.012488 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:28:21.012488 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:28:21.012488 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:28:21.012488 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:28:21.012488 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:28:21.012488 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 12:28:21.012488 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 12:28:21.012488 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 12:28:21.012488 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:28:21.012488 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 389/782] 10.222.0.55 () {56 vars in 1132 bytes} [Wed Jul 27 12:28:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:28:21.017407 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958d403-2890-4b0d-9500-1f3c576bce5f None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:21.058787 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:21.067630 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 394/783] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:28:20 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 12:28:21.090931 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bee514-0009-44d9-9ad9-7b6b1469d660 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:21.117506 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958d403-2890-4b0d-9500-1f3c576bce5f None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:21.151479 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ccc358-6fed-41f1-9846-2ea784676153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:21.152094 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccc358-6fed-41f1-9846-2ea784676153 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:21.152380 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccc358-6fed-41f1-9846-2ea784676153 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:21.152659 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccc358-6fed-41f1-9846-2ea784676153 None admin] PATH_INFO: `/v3/services` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:21.153359 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ccc358-6fed-41f1-9846-2ea784676153 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:21.153698 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ccc358-6fed-41f1-9846-2ea784676153 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:21.155070 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ccc358-6fed-41f1-9846-2ea784676153 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:21.164784 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 390/784] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Jul 27 12:28:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:28:21.165808 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ccc358-6fed-41f1-9846-2ea784676153 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:21.187569 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bee514-0009-44d9-9ad9-7b6b1469d660 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:21.221470 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295468d8-1d40-4a86-bd5d-e5f6f723e510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:21.222072 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295468d8-1d40-4a86-bd5d-e5f6f723e510 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:21.222358 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295468d8-1d40-4a86-bd5d-e5f6f723e510 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:21.222640 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295468d8-1d40-4a86-bd5d-e5f6f723e510 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:21.223265 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295468d8-1d40-4a86-bd5d-e5f6f723e510 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:21.224642 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295468d8-1d40-4a86-bd5d-e5f6f723e510 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:21.226593 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:21.234967 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-295468d8-1d40-4a86-bd5d-e5f6f723e510 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 12:28:21.234967 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:21.234967 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 12:28:21.234967 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 12:28:21.234967 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 12:28:21.234967 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 12:28:21.234967 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 12:28:21.234967 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 12:28:21.234967 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 12:28:21.234967 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:28:21.234967 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 12:28:21.234967 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:28:21.234967 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:21.234967 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:28:21.234967 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:28:21.234967 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:28:21.234967 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:28:21.235991 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:28:21.235991 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:28:21.235991 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:28:21.235991 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:28:21.235991 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:28:21.235991 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:28:21.235991 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 12:28:21.235991 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 12:28:21.235991 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 12:28:21.235991 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 12:28:21.235991 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:28:21.235991 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:28:21.235991 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:28:21.235991 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:28:21.235991 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:28:21.235991 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:28:21.236840 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:28:21.236840 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:28:21.236840 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:28:21.236840 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:28:21.236840 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:28:21.236840 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:28:21.236840 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:28:21.236840 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:28:21.236840 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:28:21.236840 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:28:21.236840 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 12:28:21.236840 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 12:28:21.236840 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 12:28:21.236840 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:28:21.236840 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 395/785] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jul 27 12:28:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 12:28:21.242323 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295468d8-1d40-4a86-bd5d-e5f6f723e510 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:21.270063 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ccc358-6fed-41f1-9846-2ea784676153 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:21.298562 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:21.304181 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d932aa2-26bf-4fd0-b8b4-db95b2b824aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:21.304793 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d932aa2-26bf-4fd0-b8b4-db95b2b824aa None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:21.305109 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d932aa2-26bf-4fd0-b8b4-db95b2b824aa None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:21.305369 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d932aa2-26bf-4fd0-b8b4-db95b2b824aa None admin] PATH_INFO: `/v3/services` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:21.306069 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d932aa2-26bf-4fd0-b8b4-db95b2b824aa None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:21.306380 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d932aa2-26bf-4fd0-b8b4-db95b2b824aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:21.307715 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d932aa2-26bf-4fd0-b8b4-db95b2b824aa None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:21.312359 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 391/786] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Jul 27 12:28:21 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:28:21.317945 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d932aa2-26bf-4fd0-b8b4-db95b2b824aa None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:21.339964 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295468d8-1d40-4a86-bd5d-e5f6f723e510 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:21.375469 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9579563-8537-450d-8f29-f3b8a8360e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:21.376080 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9579563-8537-450d-8f29-f3b8a8360e68 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:21.376360 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9579563-8537-450d-8f29-f3b8a8360e68 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:21.376629 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9579563-8537-450d-8f29-f3b8a8360e68 None admin] PATH_INFO: `/v3/services` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:21.377299 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9579563-8537-450d-8f29-f3b8a8360e68 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:21.377655 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9579563-8537-450d-8f29-f3b8a8360e68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:21.378974 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9579563-8537-450d-8f29-f3b8a8360e68 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:21.383515 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 396/787] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jul 27 12:28:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:28:21.389286 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9579563-8537-450d-8f29-f3b8a8360e68 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:21.417522 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d932aa2-26bf-4fd0-b8b4-db95b2b824aa None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:21.440342 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:21.451989 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9d57e-7744-43a9-9432-6ac9803218ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:21.452599 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9d57e-7744-43a9-9432-6ac9803218ec None admin] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:21.453432 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9d57e-7744-43a9-9432-6ac9803218ec None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:21.453756 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9d57e-7744-43a9-9432-6ac9803218ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:21.454473 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9d57e-7744-43a9-9432-6ac9803218ec None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:21.455818 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9d57e-7744-43a9-9432-6ac9803218ec None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:21.475790 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 392/788] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Jul 27 12:28:21 2022] POST /identity/v3/endpoints => generated 347 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 12:28:21.490872 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9579563-8537-450d-8f29-f3b8a8360e68 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:21.516772 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:21.536559 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b8b3f-a474-4a47-8e46-844b0cc57df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:21.537194 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b8b3f-a474-4a47-8e46-844b0cc57df0 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:21.537473 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b8b3f-a474-4a47-8e46-844b0cc57df0 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:21.537782 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b8b3f-a474-4a47-8e46-844b0cc57df0 None admin] PATH_INFO: `/v3/services` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:21.538471 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b8b3f-a474-4a47-8e46-844b0cc57df0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:21.538772 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b8b3f-a474-4a47-8e46-844b0cc57df0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:21.540179 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b8b3f-a474-4a47-8e46-844b0cc57df0 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:21.550481 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 397/789] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Jul 27 12:28:21 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:28:21.551692 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9d57e-7744-43a9-9432-6ac9803218ec None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:21.658806 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9d57e-7744-43a9-9432-6ac9803218ec None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:21.695134 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f44b6a-41d8-4f0d-862b-40d90904ca92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:21.695761 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f44b6a-41d8-4f0d-862b-40d90904ca92 None admin] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:21.696043 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f44b6a-41d8-4f0d-862b-40d90904ca92 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:21.696318 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f44b6a-41d8-4f0d-862b-40d90904ca92 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:21.697028 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f44b6a-41d8-4f0d-862b-40d90904ca92 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:21.698416 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f44b6a-41d8-4f0d-862b-40d90904ca92 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:21.719400 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 393/790] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Jul 27 12:28:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 12:28:23.695363 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944292c-7c26-427a-8037-fa55a7126577 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:23.695757 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944292c-7c26-427a-8037-fa55a7126577 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:23.695908 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944292c-7c26-427a-8037-fa55a7126577 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:23.697248 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 398/791] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:28:23.702547 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614ed53-ec6b-48dd-8511-0edc71f5b91f None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:23.702961 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614ed53-ec6b-48dd-8511-0edc71f5b91f None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:23.703255 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614ed53-ec6b-48dd-8511-0edc71f5b91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:23.720772 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-4614ed53-ec6b-48dd-8511-0edc71f5b91f None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:28:23.721972 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-4614ed53-ec6b-48dd-8511-0edc71f5b91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:28:23.750628 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:23.794092 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 394/792] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:28:23 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 12:28:23.818262 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944292c-7c26-427a-8037-fa55a7126577 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:23.918663 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944292c-7c26-427a-8037-fa55a7126577 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:23.952109 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1686a59c-3f9c-4a4c-a50d-3304a0b7b524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:23.952683 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686a59c-3f9c-4a4c-a50d-3304a0b7b524 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:23.952967 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686a59c-3f9c-4a4c-a50d-3304a0b7b524 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:23.953068 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eeceb7-dd30-4d22-947e-23db52406ba7 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:23.953242 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686a59c-3f9c-4a4c-a50d-3304a0b7b524 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:23.953341 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eeceb7-dd30-4d22-947e-23db52406ba7 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:23.953575 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eeceb7-dd30-4d22-947e-23db52406ba7 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:23.953902 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1686a59c-3f9c-4a4c-a50d-3304a0b7b524 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:23.954956 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 395/793] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 12:28:23.955270 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1686a59c-3f9c-4a4c-a50d-3304a0b7b524 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:23.959918 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535a6c7-40e6-4bfc-a054-e70c52659689 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:23.960204 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535a6c7-40e6-4bfc-a054-e70c52659689 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:23.960483 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535a6c7-40e6-4bfc-a054-e70c52659689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:23.964243 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-1686a59c-3f9c-4a4c-a50d-3304a0b7b524 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 12:28:23.964243 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:23.964243 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 12:28:23.964243 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 12:28:23.964243 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 12:28:23.964243 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 12:28:23.964243 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 12:28:23.964243 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 12:28:23.964243 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 12:28:23.964243 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:28:23.964243 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 12:28:23.964243 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:28:23.964243 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:23.964243 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:28:23.964243 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:28:23.964243 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:28:23.964243 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:28:23.965330 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:28:23.965330 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:28:23.965330 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:28:23.965330 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:28:23.965330 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:28:23.965330 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:28:23.965330 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 12:28:23.965330 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 12:28:23.965330 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 12:28:23.965330 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 12:28:23.965330 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:28:23.965330 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:28:23.965330 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:28:23.965330 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:28:23.965330 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:28:23.965330 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:28:23.966210 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:28:23.966210 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:28:23.966210 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:28:23.966210 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:28:23.966210 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:28:23.966210 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:28:23.966210 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:28:23.966210 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:28:23.966210 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:28:23.966210 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:28:23.966210 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 12:28:23.966210 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 12:28:23.966210 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 12:28:23.966210 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:28:23.966210 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 399/794] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jul 27 12:28:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:28:23.970947 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1686a59c-3f9c-4a4c-a50d-3304a0b7b524 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:23.978184 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-d535a6c7-40e6-4bfc-a054-e70c52659689 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:28:23.979365 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-d535a6c7-40e6-4bfc-a054-e70c52659689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:28:24.018760 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:24.046274 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 396/795] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:28:23 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 12:28:24.070333 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535a6c7-40e6-4bfc-a054-e70c52659689 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:24.073047 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1686a59c-3f9c-4a4c-a50d-3304a0b7b524 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:24.106985 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc5fd7-c548-4c1e-bff9-e5acb6126b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:24.107604 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc5fd7-c548-4c1e-bff9-e5acb6126b2f None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:24.107884 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc5fd7-c548-4c1e-bff9-e5acb6126b2f None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:24.108159 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc5fd7-c548-4c1e-bff9-e5acb6126b2f None admin] PATH_INFO: `/v3/services` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:24.108830 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc5fd7-c548-4c1e-bff9-e5acb6126b2f None admin] RBAC: Adding query filter params (name=compute) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:24.109155 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc5fd7-c548-4c1e-bff9-e5acb6126b2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:24.110565 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc5fd7-c548-4c1e-bff9-e5acb6126b2f None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:24.115529 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 400/796] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jul 27 12:28:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:28:24.121471 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc5fd7-c548-4c1e-bff9-e5acb6126b2f None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:24.160062 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:24.169163 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535a6c7-40e6-4bfc-a054-e70c52659689 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:24.204177 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12983ef3-0e19-4fda-ad00-f2810e053b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:24.204717 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12983ef3-0e19-4fda-ad00-f2810e053b9d None admin] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:24.205005 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12983ef3-0e19-4fda-ad00-f2810e053b9d None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:24.205279 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12983ef3-0e19-4fda-ad00-f2810e053b9d None admin] PATH_INFO: `/v3/projects` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:24.205971 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12983ef3-0e19-4fda-ad00-f2810e053b9d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:24.207388 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12983ef3-0e19-4fda-ad00-f2810e053b9d None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:24.210008 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: WARNING keystone.server.flask.common [None req-12983ef3-0e19-4fda-ad00-f2810e053b9d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 27 12:28:24.219879 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc5fd7-c548-4c1e-bff9-e5acb6126b2f None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:24.226115 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.sql.core [None req-12983ef3-0e19-4fda-ad00-f2810e053b9d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 12:28:24.226115 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 27 12:28:24.226115 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [parameters: {'id': '182ce58961554b64a208bee48cac5a37', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 27 12:28:24.226115 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87918) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 27 12:28:24.230394 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:24.242925 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-12983ef3-0e19-4fda-ad00-f2810e053b9d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 182ce58961554b64a208bee48cac5a37.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 182ce58961554b64a208bee48cac5a37. Jul 27 12:28:24.242925 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:24.242925 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 12:28:24.242925 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 12:28:24.242925 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 12:28:24.242925 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 12:28:24.242925 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 12:28:24.242925 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 12:28:24.242925 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 12:28:24.242925 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application conn.query(q) Jul 27 12:28:24.242925 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 12:28:24.242925 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 12:28:24.242925 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 12:28:24.243802 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application result.read() Jul 27 12:28:24.243802 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 12:28:24.243802 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 12:28:24.243802 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 12:28:24.243802 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 12:28:24.243802 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 12:28:24.243802 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 12:28:24.243802 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 12:28:24.243802 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 12:28:24.243802 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 12:28:24.243802 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:28:24.243802 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 27 12:28:24.243802 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:28:24.243802 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:24.243802 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 27 12:28:24.243802 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 27 12:28:24.243802 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 27 12:28:24.243802 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 27 12:28:24.245035 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 12:28:24.245035 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application next(self.gen) Jul 27 12:28:24.245035 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 27 12:28:24.245035 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application yield resource Jul 27 12:28:24.245035 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 12:28:24.245035 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application next(self.gen) Jul 27 12:28:24.245035 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 27 12:28:24.245035 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application self.session.rollback() Jul 27 12:28:24.245035 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 12:28:24.245035 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application self.force_reraise() Jul 27 12:28:24.245035 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 12:28:24.245035 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise self.value Jul 27 12:28:24.245035 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 27 12:28:24.245035 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 27 12:28:24.245035 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 27 12:28:24.245035 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application session.commit() Jul 27 12:28:24.245035 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 27 12:28:24.246317 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 27 12:28:24.246317 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 27 12:28:24.246317 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application self._prepare_impl() Jul 27 12:28:24.246317 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 27 12:28:24.246317 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application self.session.flush() Jul 27 12:28:24.246317 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 27 12:28:24.246317 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application self._flush(objects) Jul 27 12:28:24.246317 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 27 12:28:24.246317 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 27 12:28:24.246317 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 27 12:28:24.246317 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application compat.raise_( Jul 27 12:28:24.246317 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 12:28:24.246317 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception Jul 27 12:28:24.246317 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 27 12:28:24.246317 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application flush_context.execute() Jul 27 12:28:24.246317 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 27 12:28:24.246317 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rec.execute(self) Jul 27 12:28:24.247505 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 27 12:28:24.247505 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 27 12:28:24.247505 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 27 12:28:24.247505 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 27 12:28:24.247505 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 27 12:28:24.247505 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 27 12:28:24.247505 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 27 12:28:24.247505 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 27 12:28:24.247505 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 27 12:28:24.247505 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 27 12:28:24.247505 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 27 12:28:24.247505 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 27 12:28:24.247505 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 27 12:28:24.247505 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 27 12:28:24.247505 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 27 12:28:24.248531 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 27 12:28:24.248531 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 12:28:24.248531 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception Jul 27 12:28:24.248531 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 12:28:24.248531 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 12:28:24.248531 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 12:28:24.248531 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 12:28:24.248531 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 12:28:24.248531 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 12:28:24.248531 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 12:28:24.248531 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application conn.query(q) Jul 27 12:28:24.248531 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 12:28:24.248531 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 12:28:24.248531 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 12:28:24.248531 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application result.read() Jul 27 12:28:24.248531 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 12:28:24.248531 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 12:28:24.250411 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 12:28:24.250411 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 12:28:24.250411 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 12:28:24.250411 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 12:28:24.250411 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 12:28:24.250411 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 12:28:24.250411 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 12:28:24.250411 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 27 12:28:24.250411 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [parameters: {'id': '182ce58961554b64a208bee48cac5a37', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 27 12:28:24.250411 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 27 12:28:24.250411 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:28:24.250411 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 12:28:24.250411 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:28:24.250411 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:24.250411 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 27 12:28:24.251409 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 27 12:28:24.251409 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 27 12:28:24.251409 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 27 12:28:24.251409 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 27 12:28:24.251409 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:28:24.251409 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 12:28:24.251409 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:28:24.251409 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:24.251409 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:28:24.251409 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:28:24.251409 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:28:24.251409 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:28:24.251409 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:28:24.251409 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:28:24.251409 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:28:24.251409 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:28:24.251409 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:28:24.252525 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:28:24.252525 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 27 12:28:24.252525 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 27 12:28:24.252525 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:28:24.252525 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:28:24.252525 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 27 12:28:24.252525 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 27 12:28:24.252525 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 182ce58961554b64a208bee48cac5a37. Jul 27 12:28:24.252525 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:28:24.252525 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 397/797] 10.222.0.55 () {60 vars in 1140 bytes} [Wed Jul 27 12:28:24 2022] POST /identity/v3/projects => generated 262 bytes in 174 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 27 12:28:24.252525 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12983ef3-0e19-4fda-ad00-f2810e053b9d None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:24.264255 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5ab4e-d510-4492-acf2-8ff90e3032cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:24.265894 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5ab4e-d510-4492-acf2-8ff90e3032cb None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:24.266197 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5ab4e-d510-4492-acf2-8ff90e3032cb None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:24.266500 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5ab4e-d510-4492-acf2-8ff90e3032cb None admin] PATH_INFO: `/v3/services` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:24.267261 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5ab4e-d510-4492-acf2-8ff90e3032cb None admin] RBAC: Adding query filter params (type=compute) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:24.267567 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5ab4e-d510-4492-acf2-8ff90e3032cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:24.269130 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5ab4e-d510-4492-acf2-8ff90e3032cb None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:24.273818 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 401/798] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jul 27 12:28:24 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:28:24.360635 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12983ef3-0e19-4fda-ad00-f2810e053b9d None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:24.398271 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fc248-c1df-42c9-884a-f19f1997b77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:24.398932 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fc248-c1df-42c9-884a-f19f1997b77d None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:24.399221 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fc248-c1df-42c9-884a-f19f1997b77d None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:24.399497 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fc248-c1df-42c9-884a-f19f1997b77d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:24.407250 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33fc248-c1df-42c9-884a-f19f1997b77d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:24.408990 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33fc248-c1df-42c9-884a-f19f1997b77d None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:24.420878 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-e33fc248-c1df-42c9-884a-f19f1997b77d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 12:28:24.420878 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:24.420878 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:28:24.420878 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:28:24.420878 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:28:24.420878 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:28:24.420878 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:28:24.420878 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:28:24.420878 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:28:24.420878 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:28:24.420878 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:28:24.420878 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:28:24.420878 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 12:28:24.420878 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 12:28:24.420878 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 12:28:24.422603 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 12:28:24.422603 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:28:24.422603 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:28:24.422603 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:28:24.422603 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:28:24.422603 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:28:24.422603 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:28:24.422603 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:28:24.422603 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:28:24.422603 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:28:24.422603 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:28:24.422603 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:28:24.422603 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:28:24.422603 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:28:24.422603 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:28:24.422603 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:28:24.422603 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:28:24.423552 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 12:28:24.423552 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 12:28:24.423552 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 12:28:24.423552 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 12:28:24.423552 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 12:28:24.423552 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 12:28:24.423552 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 12:28:24.423552 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:28:24.424305 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 398/799] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jul 27 12:28:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:28:24.428758 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5ab4e-d510-4492-acf2-8ff90e3032cb None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:24.526891 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5ab4e-d510-4492-acf2-8ff90e3032cb None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:24.559771 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e6c96-c8e8-4ef7-8b62-246c79de7020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:24.560381 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e6c96-c8e8-4ef7-8b62-246c79de7020 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:24.560659 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e6c96-c8e8-4ef7-8b62-246c79de7020 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:24.560929 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e6c96-c8e8-4ef7-8b62-246c79de7020 None admin] PATH_INFO: `/v3/projects` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:24.561667 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e6c96-c8e8-4ef7-8b62-246c79de7020 None admin] RBAC: Adding query filter params (name=service) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:24.562009 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e6c96-c8e8-4ef7-8b62-246c79de7020 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:24.563934 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e6c96-c8e8-4ef7-8b62-246c79de7020 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:24.580491 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 402/800] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jul 27 12:28:24 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:28:26.464538 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c67e83-45be-404d-acc2-dcfc0881f196 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:26.465057 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c67e83-45be-404d-acc2-dcfc0881f196 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:26.465057 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c67e83-45be-404d-acc2-dcfc0881f196 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:26.469790 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 399/801] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:28:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:28:26.474870 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391de3b-454c-4358-a58e-176689c4a93f None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:26.475274 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391de3b-454c-4358-a58e-176689c4a93f None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:26.475424 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391de3b-454c-4358-a58e-176689c4a93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:26.493395 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-2391de3b-454c-4358-a58e-176689c4a93f None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:28:26.494594 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-2391de3b-454c-4358-a58e-176689c4a93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:28:26.520955 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:26.559417 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 403/802] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:28:26 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 12:28:26.583613 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c67e83-45be-404d-acc2-dcfc0881f196 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:26.594858 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:26.687614 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c67e83-45be-404d-acc2-dcfc0881f196 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:26.720096 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d7e3e-3a8c-4ddf-ac4e-74d9b4f77ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:26.720644 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d7e3e-3a8c-4ddf-ac4e-74d9b4f77ac0 None admin] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:26.720927 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d7e3e-3a8c-4ddf-ac4e-74d9b4f77ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:26.721201 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d7e3e-3a8c-4ddf-ac4e-74d9b4f77ac0 None admin] PATH_INFO: `/v3/services` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:26.721928 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690d7e3e-3a8c-4ddf-ac4e-74d9b4f77ac0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:26.723285 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690d7e3e-3a8c-4ddf-ac4e-74d9b4f77ac0 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:26.738249 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 400/803] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jul 27 12:28:26 2022] POST /identity/v3/services => generated 242 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 12:28:26.923751 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004f1c6-b232-452b-a813-118d21c4fbd1 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:26.924112 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004f1c6-b232-452b-a813-118d21c4fbd1 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:26.924400 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004f1c6-b232-452b-a813-118d21c4fbd1 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:26.925794 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 404/804] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:28:26.931039 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df9442-da59-4f61-b525-95dad700f5ae None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:26.931337 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df9442-da59-4f61-b525-95dad700f5ae None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:26.931615 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df9442-da59-4f61-b525-95dad700f5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:26.950009 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-90df9442-da59-4f61-b525-95dad700f5ae None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:28:26.951558 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-90df9442-da59-4f61-b525-95dad700f5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:28:27.014534 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:27.027366 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 401/805] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:28:26 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 12:28:27.053620 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004f1c6-b232-452b-a813-118d21c4fbd1 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:27.157814 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004f1c6-b232-452b-a813-118d21c4fbd1 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:27.191107 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21c704-6bc8-4deb-ab22-d976f8a0d007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:27.191728 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21c704-6bc8-4deb-ab22-d976f8a0d007 None admin] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:27.192013 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21c704-6bc8-4deb-ab22-d976f8a0d007 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:27.192294 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21c704-6bc8-4deb-ab22-d976f8a0d007 None admin] PATH_INFO: `/v3/users` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:27.192962 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21c704-6bc8-4deb-ab22-d976f8a0d007 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:27.194434 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21c704-6bc8-4deb-ab22-d976f8a0d007 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:27.196987 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: WARNING keystone.server.flask.common [None req-8f21c704-6bc8-4deb-ab22-d976f8a0d007 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 27 12:28:27.209700 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.sql.core [None req-8f21c704-6bc8-4deb-ab22-d976f8a0d007 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 12:28:27.209700 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 27 12:28:27.209700 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [parameters: {'user_id': 'bad10e56e9d14cfface62581f235e3a2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 27 12:28:27.209700 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87917) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 27 12:28:27.225655 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-8f21c704-6bc8-4deb-ab22-d976f8a0d007 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 27 12:28:27.225655 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:27.225655 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 12:28:27.225655 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 12:28:27.225655 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 12:28:27.225655 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 12:28:27.225655 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 12:28:27.225655 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 12:28:27.225655 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 12:28:27.225655 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application conn.query(q) Jul 27 12:28:27.225655 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 12:28:27.225655 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 12:28:27.225655 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 12:28:27.225655 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application result.read() Jul 27 12:28:27.225655 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 12:28:27.226756 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 12:28:27.226756 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 12:28:27.226756 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 12:28:27.226756 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 12:28:27.226756 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 12:28:27.226756 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 12:28:27.226756 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 12:28:27.226756 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 12:28:27.226756 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:28:27.226756 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 27 12:28:27.226756 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:28:27.226756 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:27.226756 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 27 12:28:27.226756 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 27 12:28:27.226756 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 27 12:28:27.226756 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 27 12:28:27.226756 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 12:28:27.226756 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application next(self.gen) Jul 27 12:28:27.228112 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 27 12:28:27.228112 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application yield resource Jul 27 12:28:27.228112 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 12:28:27.228112 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application next(self.gen) Jul 27 12:28:27.228112 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 27 12:28:27.228112 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application self.session.rollback() Jul 27 12:28:27.228112 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 12:28:27.228112 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application self.force_reraise() Jul 27 12:28:27.228112 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 12:28:27.228112 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise self.value Jul 27 12:28:27.228112 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 27 12:28:27.228112 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 27 12:28:27.228112 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 27 12:28:27.228112 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application session.commit() Jul 27 12:28:27.228112 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 27 12:28:27.228112 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 27 12:28:27.228112 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 27 12:28:27.229250 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application self._prepare_impl() Jul 27 12:28:27.229250 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 27 12:28:27.229250 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application self.session.flush() Jul 27 12:28:27.229250 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 27 12:28:27.229250 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application self._flush(objects) Jul 27 12:28:27.229250 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 27 12:28:27.229250 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 27 12:28:27.229250 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 27 12:28:27.229250 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application compat.raise_( Jul 27 12:28:27.229250 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 12:28:27.229250 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception Jul 27 12:28:27.229250 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 27 12:28:27.229250 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application flush_context.execute() Jul 27 12:28:27.229250 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 27 12:28:27.229250 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rec.execute(self) Jul 27 12:28:27.229250 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 27 12:28:27.229250 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 27 12:28:27.230487 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 27 12:28:27.230487 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 27 12:28:27.230487 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 27 12:28:27.230487 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 27 12:28:27.230487 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 27 12:28:27.230487 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 27 12:28:27.230487 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 27 12:28:27.230487 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 27 12:28:27.230487 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 27 12:28:27.230487 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 27 12:28:27.230487 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 27 12:28:27.230487 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 27 12:28:27.230487 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 27 12:28:27.230487 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 27 12:28:27.230487 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 12:28:27.230487 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception Jul 27 12:28:27.231386 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 12:28:27.231386 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 12:28:27.231386 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 12:28:27.231386 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 12:28:27.231386 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 12:28:27.231386 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 12:28:27.231386 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 12:28:27.231386 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application conn.query(q) Jul 27 12:28:27.231386 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 12:28:27.231386 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 12:28:27.231386 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 12:28:27.231386 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application result.read() Jul 27 12:28:27.231386 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 12:28:27.231386 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 12:28:27.231386 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 12:28:27.231386 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 12:28:27.232424 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 12:28:27.232424 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 12:28:27.232424 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 12:28:27.232424 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 12:28:27.232424 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 12:28:27.232424 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 27 12:28:27.232424 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [parameters: {'user_id': 'bad10e56e9d14cfface62581f235e3a2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 27 12:28:27.232424 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 27 12:28:27.232424 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:28:27.232424 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 12:28:27.232424 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:28:27.232424 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:27.232424 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:28:27.232424 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:28:27.232424 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:28:27.233470 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:28:27.233470 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:28:27.233470 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:28:27.233470 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:28:27.233470 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:28:27.233470 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:28:27.233470 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:28:27.233470 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 27 12:28:27.233470 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 27 12:28:27.233470 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:28:27.233470 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:28:27.233470 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 12:28:27.233470 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:28:27.233470 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 12:28:27.233470 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:28:27.233470 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 27 12:28:27.233470 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 27 12:28:27.234757 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 27 12:28:27.234757 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 27 12:28:27.234757 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 27 12:28:27.234757 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 27 12:28:27.234757 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 27 12:28:27.234757 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:28:27.234757 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 405/806] 10.222.0.55 () {60 vars in 1131 bytes} [Wed Jul 27 12:28:27 2022] POST /identity/v3/users => generated 160 bytes in 179 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:28:27.235366 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df9442-da59-4f61-b525-95dad700f5ae None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:27.335575 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df9442-da59-4f61-b525-95dad700f5ae None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:27.368171 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c06584-e91c-45df-af5a-9dd304fa4ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:27.368803 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c06584-e91c-45df-af5a-9dd304fa4ead None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:27.369084 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c06584-e91c-45df-af5a-9dd304fa4ead None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:27.369358 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c06584-e91c-45df-af5a-9dd304fa4ead None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:27.376652 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c06584-e91c-45df-af5a-9dd304fa4ead None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:27.378108 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c06584-e91c-45df-af5a-9dd304fa4ead None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:27.393764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-a7c06584-e91c-45df-af5a-9dd304fa4ead None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 12:28:27.393764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:27.393764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:28:27.393764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:28:27.393764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:28:27.393764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:28:27.393764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:28:27.393764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:28:27.393764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:28:27.393764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:28:27.393764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:28:27.393764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:28:27.393764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 12:28:27.393764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 12:28:27.393764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 12:28:27.393764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 12:28:27.394789 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:28:27.394789 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:28:27.394789 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 12:28:27.394789 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:28:27.394789 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 12:28:27.394789 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:28:27.394789 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:28:27.394789 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:28:27.394789 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:28:27.394789 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:28:27.394789 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:28:27.394789 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:28:27.394789 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:28:27.394789 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:28:27.394789 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:28:27.394789 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:28:27.394789 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:28:27.394789 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:28:27.395743 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:28:27.395743 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:28:27.395743 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 12:28:27.395743 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 12:28:27.395743 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 12:28:27.395743 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 12:28:27.395743 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 12:28:27.395743 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 12:28:27.395743 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 12:28:27.395743 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:28:27.395743 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 402/807] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:28:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:28:27.401101 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21c704-6bc8-4deb-ab22-d976f8a0d007 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:27.429305 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:27.500235 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21c704-6bc8-4deb-ab22-d976f8a0d007 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:27.531840 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21217a1c-ff9b-47db-ad22-072c86f3685b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:27.532453 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21217a1c-ff9b-47db-ad22-072c86f3685b None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:27.532759 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21217a1c-ff9b-47db-ad22-072c86f3685b None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:27.533032 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21217a1c-ff9b-47db-ad22-072c86f3685b None admin] PATH_INFO: `/v3/users` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:27.533815 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21217a1c-ff9b-47db-ad22-072c86f3685b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:27.534118 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21217a1c-ff9b-47db-ad22-072c86f3685b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:27.535750 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21217a1c-ff9b-47db-ad22-072c86f3685b None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:27.574548 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 406/808] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Jul 27 12:28:27 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:28:29.014887 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89b56d-7a4f-43ab-a6b1-b3cf68673d96 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:29.015427 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89b56d-7a4f-43ab-a6b1-b3cf68673d96 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:29.015427 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89b56d-7a4f-43ab-a6b1-b3cf68673d96 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:29.016740 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 403/809] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:28:29.021888 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6afe1-c508-43d4-a3bf-c1d85daff89e None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:29.022291 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6afe1-c508-43d4-a3bf-c1d85daff89e None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:29.022443 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6afe1-c508-43d4-a3bf-c1d85daff89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:29.040455 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-2bd6afe1-c508-43d4-a3bf-c1d85daff89e None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:28:29.041994 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-2bd6afe1-c508-43d4-a3bf-c1d85daff89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:28:29.105650 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 407/810] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:28:29 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 12:28:29.129885 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c89b56d-7a4f-43ab-a6b1-b3cf68673d96 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:29.184503 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:29.229355 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c89b56d-7a4f-43ab-a6b1-b3cf68673d96 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:29.263032 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74227873-cbf5-4808-b160-434ed25ba4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:29.263654 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74227873-cbf5-4808-b160-434ed25ba4d0 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:29.263935 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74227873-cbf5-4808-b160-434ed25ba4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:29.264212 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74227873-cbf5-4808-b160-434ed25ba4d0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:29.264835 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74227873-cbf5-4808-b160-434ed25ba4d0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:29.266367 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74227873-cbf5-4808-b160-434ed25ba4d0 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:29.275229 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-74227873-cbf5-4808-b160-434ed25ba4d0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 12:28:29.275229 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:29.275229 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 12:28:29.275229 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 12:28:29.275229 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 12:28:29.275229 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 12:28:29.275229 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 12:28:29.275229 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 12:28:29.275229 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 12:28:29.275229 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:28:29.275229 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 12:28:29.275229 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:28:29.275229 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:29.275229 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:28:29.275229 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:28:29.275229 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:28:29.275229 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:28:29.276377 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:28:29.276377 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:28:29.276377 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:28:29.276377 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:28:29.276377 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:28:29.276377 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:28:29.276377 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 12:28:29.276377 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 12:28:29.276377 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 12:28:29.276377 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 12:28:29.276377 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:28:29.276377 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:28:29.276377 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:28:29.276377 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:28:29.276377 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:28:29.276377 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:28:29.277572 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:28:29.277572 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:28:29.277572 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:28:29.277572 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:28:29.277572 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:28:29.277572 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:28:29.277572 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:28:29.277572 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:28:29.277572 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:28:29.277572 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:28:29.277572 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 12:28:29.277572 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 12:28:29.277572 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 12:28:29.277572 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:28:29.277572 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 404/811] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jul 27 12:28:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:28:29.282897 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6afe1-c508-43d4-a3bf-c1d85daff89e None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:29.298256 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:29.387413 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6afe1-c508-43d4-a3bf-c1d85daff89e None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:29.420324 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53187338-f620-448b-9ee8-33d8b4cef3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:29.420930 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53187338-f620-448b-9ee8-33d8b4cef3f9 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:29.421204 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53187338-f620-448b-9ee8-33d8b4cef3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:29.422112 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53187338-f620-448b-9ee8-33d8b4cef3f9 None admin] PATH_INFO: `/v3/services` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:29.422785 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53187338-f620-448b-9ee8-33d8b4cef3f9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:29.423083 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53187338-f620-448b-9ee8-33d8b4cef3f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:29.424444 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53187338-f620-448b-9ee8-33d8b4cef3f9 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:29.429129 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 408/812] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jul 27 12:28:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:28:29.434886 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74227873-cbf5-4808-b160-434ed25ba4d0 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:29.531261 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74227873-cbf5-4808-b160-434ed25ba4d0 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:29.552495 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:29.569183 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8598e-a735-4b3a-a406-edcd05b71f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:29.569821 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8598e-a735-4b3a-a406-edcd05b71f82 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:29.570104 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8598e-a735-4b3a-a406-edcd05b71f82 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:29.570379 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8598e-a735-4b3a-a406-edcd05b71f82 None admin] PATH_INFO: `/v3/services` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:29.571049 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe8598e-a735-4b3a-a406-edcd05b71f82 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:29.571356 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe8598e-a735-4b3a-a406-edcd05b71f82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:29.572704 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe8598e-a735-4b3a-a406-edcd05b71f82 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:29.577412 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 405/813] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jul 27 12:28:29 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:28:29.583233 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53187338-f620-448b-9ee8-33d8b4cef3f9 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:29.658425 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:29.678882 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53187338-f620-448b-9ee8-33d8b4cef3f9 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:29.711891 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f6808f-240a-45a9-a46c-a14f16c80cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:29.712511 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6808f-240a-45a9-a46c-a14f16c80cb3 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:29.712796 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6808f-240a-45a9-a46c-a14f16c80cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:29.713072 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6808f-240a-45a9-a46c-a14f16c80cb3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:29.713856 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f6808f-240a-45a9-a46c-a14f16c80cb3 None admin] RBAC: Adding query filter params (interface=public, service_id=197adcbb941149f58d90119ea98f6702, region_id=RegionOne) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:29.714169 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f6808f-240a-45a9-a46c-a14f16c80cb3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:29.715543 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f6808f-240a-45a9-a46c-a14f16c80cb3 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:29.721128 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 409/814] 10.222.0.55 () {56 vars in 1251 bytes} [Wed Jul 27 12:28:29 2022] GET /identity/v3/endpoints?service_id=197adcbb941149f58d90119ea98f6702&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:28:29.726672 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8598e-a735-4b3a-a406-edcd05b71f82 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:29.822234 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8598e-a735-4b3a-a406-edcd05b71f82 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:29.854684 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b84b17-5019-4cb3-b963-cb11bf41aec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:29.855282 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b84b17-5019-4cb3-b963-cb11bf41aec1 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:29.855565 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b84b17-5019-4cb3-b963-cb11bf41aec1 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:29.855841 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b84b17-5019-4cb3-b963-cb11bf41aec1 None admin] PATH_INFO: `/v3/services` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:29.856481 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b84b17-5019-4cb3-b963-cb11bf41aec1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:29.857847 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b84b17-5019-4cb3-b963-cb11bf41aec1 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:29.863808 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 406/815] 10.222.0.55 () {56 vars in 1087 bytes} [Wed Jul 27 12:28:29 2022] GET /identity/v3/services => generated 1728 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 12:28:32.073742 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58312c-d3cb-48bf-9e73-00f2cd574a49 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:32.074255 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58312c-d3cb-48bf-9e73-00f2cd574a49 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:32.074346 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58312c-d3cb-48bf-9e73-00f2cd574a49 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:32.075649 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 410/816] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:28:32.081169 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad117679-3693-4e0a-891b-a57d7fa84553 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:32.081529 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad117679-3693-4e0a-891b-a57d7fa84553 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:32.081764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad117679-3693-4e0a-891b-a57d7fa84553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:32.099808 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-ad117679-3693-4e0a-891b-a57d7fa84553 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:28:32.100980 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-ad117679-3693-4e0a-891b-a57d7fa84553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:28:32.141486 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:32.166348 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 407/817] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:28:32 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 12:28:32.189542 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58312c-d3cb-48bf-9e73-00f2cd574a49 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:32.289233 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58312c-d3cb-48bf-9e73-00f2cd574a49 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:32.321506 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e8ed0-1abf-414f-8aa7-81564d286099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:32.322166 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e8ed0-1abf-414f-8aa7-81564d286099 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:32.322512 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e8ed0-1abf-414f-8aa7-81564d286099 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:32.322794 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e8ed0-1abf-414f-8aa7-81564d286099 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:32.323411 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e8ed0-1abf-414f-8aa7-81564d286099 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:32.324835 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e8ed0-1abf-414f-8aa7-81564d286099 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:32.334062 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-b64e8ed0-1abf-414f-8aa7-81564d286099 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 12:28:32.334062 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:32.334062 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 12:28:32.334062 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 12:28:32.334062 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 12:28:32.334062 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 12:28:32.334062 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 12:28:32.334062 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 12:28:32.334062 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 12:28:32.334062 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:28:32.334062 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 12:28:32.334062 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:28:32.334062 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:28:32.334062 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:28:32.334062 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:28:32.334062 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:28:32.334062 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:28:32.335221 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:28:32.335221 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:28:32.335221 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:28:32.335221 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:28:32.335221 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:28:32.335221 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:28:32.335221 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 12:28:32.335221 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 12:28:32.335221 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 12:28:32.335221 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 12:28:32.335221 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:28:32.335221 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:28:32.335221 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:28:32.335221 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:28:32.335221 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:28:32.335221 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:28:32.336077 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:28:32.336077 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:28:32.336077 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:28:32.336077 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:28:32.336077 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:28:32.336077 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:28:32.336077 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:28:32.336077 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:28:32.336077 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:28:32.336077 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:28:32.336077 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 12:28:32.336077 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 12:28:32.336077 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 12:28:32.336077 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:28:32.336077 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 411/818] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jul 27 12:28:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:28:32.341173 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad117679-3693-4e0a-891b-a57d7fa84553 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:32.436448 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad117679-3693-4e0a-891b-a57d7fa84553 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:32.469684 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b89786-5924-489d-a4b7-120e3848cccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:32.470290 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b89786-5924-489d-a4b7-120e3848cccd None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:32.470574 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b89786-5924-489d-a4b7-120e3848cccd None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:32.470850 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b89786-5924-489d-a4b7-120e3848cccd None admin] PATH_INFO: `/v3/services` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:32.471523 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b89786-5924-489d-a4b7-120e3848cccd None admin] RBAC: Adding query filter params (name=compute) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:32.471827 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b89786-5924-489d-a4b7-120e3848cccd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:32.473183 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b89786-5924-489d-a4b7-120e3848cccd None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:32.477800 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 408/819] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jul 27 12:28:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:28:32.483467 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e8ed0-1abf-414f-8aa7-81564d286099 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:32.492745 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:32.580299 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e8ed0-1abf-414f-8aa7-81564d286099 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:32.611880 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11af07b-0e19-404c-9417-8bfc8cfda7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:32.612482 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11af07b-0e19-404c-9417-8bfc8cfda7cf None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:32.612767 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11af07b-0e19-404c-9417-8bfc8cfda7cf None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:32.613044 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11af07b-0e19-404c-9417-8bfc8cfda7cf None admin] PATH_INFO: `/v3/services` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:32.613750 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11af07b-0e19-404c-9417-8bfc8cfda7cf None admin] RBAC: Adding query filter params (type=compute) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:28:32.614066 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11af07b-0e19-404c-9417-8bfc8cfda7cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:32.615448 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11af07b-0e19-404c-9417-8bfc8cfda7cf None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:32.620346 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 412/820] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Jul 27 12:28:32 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:28:32.626609 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b89786-5924-489d-a4b7-120e3848cccd None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:28:32.669191 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:32.727040 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b89786-5924-489d-a4b7-120e3848cccd None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:28:32.759893 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b07a8-8ddf-47f1-9b96-86a3ae9ff9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:28:32.760499 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b07a8-8ddf-47f1-9b96-86a3ae9ff9ba None admin] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:28:32.760783 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b07a8-8ddf-47f1-9b96-86a3ae9ff9ba None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:28:32.761061 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b07a8-8ddf-47f1-9b96-86a3ae9ff9ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:28:32.761793 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b07a8-8ddf-47f1-9b96-86a3ae9ff9ba None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:28:32.763148 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b07a8-8ddf-47f1-9b96-86a3ae9ff9ba None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:28:32.781482 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 409/821] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Jul 27 12:28:32 2022] POST /identity/v3/endpoints => generated 334 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 12:28:42.617974 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=65 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:28:42.777380 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=51,keystone:INSERT=1 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:33.379977 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdcea6f-caf0-4330-9b8b-d88bf9040621 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:33.380756 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdcea6f-caf0-4330-9b8b-d88bf9040621 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:33.380756 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdcea6f-caf0-4330-9b8b-d88bf9040621 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:33.382206 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 413/822] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:29:33.387490 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a235511-93db-4240-a180-e006d4ab6f8c None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:33.388129 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a235511-93db-4240-a180-e006d4ab6f8c None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:33.388129 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a235511-93db-4240-a180-e006d4ab6f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:33.408552 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-1a235511-93db-4240-a180-e006d4ab6f8c None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:29:33.409896 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-1a235511-93db-4240-a180-e006d4ab6f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:29:33.517342 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 410/823] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:29:33 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 12:29:33.549331 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdcea6f-caf0-4330-9b8b-d88bf9040621 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:33.678190 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdcea6f-caf0-4330-9b8b-d88bf9040621 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:33.723311 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44cfd9-d1e9-4141-9054-f862b69cf627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:33.723962 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44cfd9-d1e9-4141-9054-f862b69cf627 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:33.724375 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44cfd9-d1e9-4141-9054-f862b69cf627 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:33.724657 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44cfd9-d1e9-4141-9054-f862b69cf627 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:33.738561 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c44cfd9-d1e9-4141-9054-f862b69cf627 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:33.740286 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c44cfd9-d1e9-4141-9054-f862b69cf627 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:33.758313 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-9c44cfd9-d1e9-4141-9054-f862b69cf627 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:29:33.758313 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:29:33.758313 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:29:33.758313 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:29:33.758313 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:29:33.758313 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:29:33.758313 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:29:33.758313 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:29:33.758313 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:29:33.758313 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:29:33.758313 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:29:33.758313 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:29:33.758313 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:29:33.758313 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:29:33.758313 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:29:33.759362 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:29:33.759362 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:29:33.759362 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:29:33.759362 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:29:33.759362 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:29:33.759362 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:29:33.759362 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:29:33.759362 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:29:33.759362 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:29:33.759362 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:29:33.759362 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:29:33.759362 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:29:33.759362 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:29:33.759362 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:29:33.759362 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:29:33.759362 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:29:33.759362 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:29:33.760844 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:29:33.760844 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:29:33.760844 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:29:33.760844 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:29:33.760844 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 414/824] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:29:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:29:33.766675 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a235511-93db-4240-a180-e006d4ab6f8c None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:33.890122 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a235511-93db-4240-a180-e006d4ab6f8c None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:33.922004 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:33.932571 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8134b7-6efe-49ed-900e-6f103ccdd399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:33.933155 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8134b7-6efe-49ed-900e-6f103ccdd399 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:33.933440 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8134b7-6efe-49ed-900e-6f103ccdd399 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:33.933791 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8134b7-6efe-49ed-900e-6f103ccdd399 None admin] PATH_INFO: `/v3/domains` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:33.934528 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8134b7-6efe-49ed-900e-6f103ccdd399 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:29:33.934834 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8134b7-6efe-49ed-900e-6f103ccdd399 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:33.936237 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8134b7-6efe-49ed-900e-6f103ccdd399 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:33.949403 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 411/825] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:29:33.956332 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44cfd9-d1e9-4141-9054-f862b69cf627 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:34.021028 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:34.072549 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44cfd9-d1e9-4141-9054-f862b69cf627 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:34.121155 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5419cad3-6be0-4e7b-a6e1-0f1df1e0fb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:34.122012 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419cad3-6be0-4e7b-a6e1-0f1df1e0fb3f None admin] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:34.122426 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419cad3-6be0-4e7b-a6e1-0f1df1e0fb3f None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:34.122742 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419cad3-6be0-4e7b-a6e1-0f1df1e0fb3f None admin] PATH_INFO: `/v3/users` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:34.123834 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5419cad3-6be0-4e7b-a6e1-0f1df1e0fb3f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:34.126274 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5419cad3-6be0-4e7b-a6e1-0f1df1e0fb3f None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:34.152730 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 415/826] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Jul 27 12:29:33 2022] POST /identity/v3/users => generated 251 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 12:29:36.606516 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea709c-56e4-4067-8887-1421b003c913 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:36.607118 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea709c-56e4-4067-8887-1421b003c913 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:36.607216 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea709c-56e4-4067-8887-1421b003c913 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:36.608979 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 412/827] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:29:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 12:29:36.614348 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798eb702-f7a3-4b41-9c0b-350083f4f0f7 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:36.614808 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798eb702-f7a3-4b41-9c0b-350083f4f0f7 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:36.614940 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798eb702-f7a3-4b41-9c0b-350083f4f0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:36.633501 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-798eb702-f7a3-4b41-9c0b-350083f4f0f7 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:29:36.634715 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-798eb702-f7a3-4b41-9c0b-350083f4f0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:29:36.708468 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 416/828] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:29:36 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 12:29:36.734360 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea709c-56e4-4067-8887-1421b003c913 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:36.845104 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea709c-56e4-4067-8887-1421b003c913 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:36.881177 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde13ba-ff58-4083-9e9b-7bcb034de492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:36.881834 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde13ba-ff58-4083-9e9b-7bcb034de492 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:36.882114 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde13ba-ff58-4083-9e9b-7bcb034de492 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:36.882432 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde13ba-ff58-4083-9e9b-7bcb034de492 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:36.893125 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fde13ba-ff58-4083-9e9b-7bcb034de492 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:29:36.898019 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-8fde13ba-ff58-4083-9e9b-7bcb034de492 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 12:29:36.898019 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:29:36.898019 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:29:36.898019 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:29:36.898019 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:29:36.898019 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:29:36.898019 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:29:36.898019 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:29:36.898019 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:29:36.898019 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:29:36.898019 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:29:36.898019 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:29:36.898019 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:29:36.898019 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:29:36.898019 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:29:36.898019 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:29:36.899255 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:29:36.899255 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:29:36.899255 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:29:36.899255 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:29:36.899255 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:29:36.899255 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:29:36.899255 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:29:36.899255 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:29:36.899255 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:29:36.899255 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:29:36.899255 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:29:36.899255 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:29:36.899255 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:29:36.899255 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:29:36.899255 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:29:36.899255 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:29:36.900303 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:29:36.900303 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:29:36.900303 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:29:36.900303 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:29:36.900303 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:29:36.900303 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:29:36.900303 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:29:36.900303 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:29:36.900303 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:29:36.900303 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:29:36.900303 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 12:29:36.900303 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:29:36.900303 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 413/829] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jul 27 12:29:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:29:36.905531 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798eb702-f7a3-4b41-9c0b-350083f4f0f7 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:36.949234 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:37.024016 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798eb702-f7a3-4b41-9c0b-350083f4f0f7 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:37.064000 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db601dc-d98f-434f-b308-c303993316d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:37.064736 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db601dc-d98f-434f-b308-c303993316d6 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:37.065021 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db601dc-d98f-434f-b308-c303993316d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:37.065295 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db601dc-d98f-434f-b308-c303993316d6 None admin] PATH_INFO: `/v3/roles` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:37.066168 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db601dc-d98f-434f-b308-c303993316d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:29:37.066593 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db601dc-d98f-434f-b308-c303993316d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:37.068548 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db601dc-d98f-434f-b308-c303993316d6 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:37.077240 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 417/830] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jul 27 12:29:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:29:37.084098 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde13ba-ff58-4083-9e9b-7bcb034de492 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:37.134898 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:37.195825 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde13ba-ff58-4083-9e9b-7bcb034de492 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:37.236994 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b965a014-3818-4359-9b00-f4dab2b163fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:37.239301 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965a014-3818-4359-9b00-f4dab2b163fc None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:37.239301 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965a014-3818-4359-9b00-f4dab2b163fc None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:37.239301 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965a014-3818-4359-9b00-f4dab2b163fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:37.250879 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b965a014-3818-4359-9b00-f4dab2b163fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:37.252645 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b965a014-3818-4359-9b00-f4dab2b163fc None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:37.271705 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-b965a014-3818-4359-9b00-f4dab2b163fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:29:37.271705 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:29:37.271705 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:29:37.271705 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:29:37.271705 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:29:37.271705 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:29:37.271705 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:29:37.271705 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:29:37.271705 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:29:37.271705 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:29:37.271705 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:29:37.271705 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:29:37.271705 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:29:37.271705 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:29:37.271705 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:29:37.272920 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:29:37.272920 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:29:37.272920 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:29:37.272920 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:29:37.272920 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:29:37.272920 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:29:37.272920 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:29:37.272920 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:29:37.272920 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:29:37.272920 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:29:37.272920 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:29:37.272920 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:29:37.272920 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:29:37.272920 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:29:37.272920 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:29:37.272920 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:29:37.272920 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:29:37.274001 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:29:37.274001 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:29:37.274001 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:29:37.274001 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:29:37.274001 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 414/831] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:29:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 12:29:37.280503 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db601dc-d98f-434f-b308-c303993316d6 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:37.397333 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:37.400058 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db601dc-d98f-434f-b308-c303993316d6 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:37.439079 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f236cf1-7441-4884-af0b-e74bbebee0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:37.439781 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f236cf1-7441-4884-af0b-e74bbebee0f0 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:37.440122 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f236cf1-7441-4884-af0b-e74bbebee0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:37.440387 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f236cf1-7441-4884-af0b-e74bbebee0f0 None admin] PATH_INFO: `/v3/domains` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:37.441161 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f236cf1-7441-4884-af0b-e74bbebee0f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:29:37.441495 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f236cf1-7441-4884-af0b-e74bbebee0f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:37.443062 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f236cf1-7441-4884-af0b-e74bbebee0f0 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:37.457278 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 418/832] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:29:37.464563 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b965a014-3818-4359-9b00-f4dab2b163fc None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:37.572150 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:37.576966 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b965a014-3818-4359-9b00-f4dab2b163fc None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:37.622633 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc88cbe-c34f-4d82-be7c-181c002a69a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:37.623353 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc88cbe-c34f-4d82-be7c-181c002a69a2 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:37.623672 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc88cbe-c34f-4d82-be7c-181c002a69a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:37.623984 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc88cbe-c34f-4d82-be7c-181c002a69a2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:37.632554 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc88cbe-c34f-4d82-be7c-181c002a69a2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:37.634123 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc88cbe-c34f-4d82-be7c-181c002a69a2 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:37.646745 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-ddc88cbe-c34f-4d82-be7c-181c002a69a2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 12:29:37.646745 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:29:37.646745 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:29:37.646745 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:29:37.646745 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:29:37.646745 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:29:37.646745 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:29:37.646745 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:29:37.646745 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:29:37.646745 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:29:37.646745 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:29:37.646745 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:29:37.646745 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 12:29:37.646745 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 12:29:37.646745 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 12:29:37.646745 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 12:29:37.647957 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:29:37.647957 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:29:37.647957 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 12:29:37.647957 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:29:37.647957 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 12:29:37.647957 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:29:37.647957 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:29:37.647957 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:29:37.647957 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:29:37.647957 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:29:37.647957 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:29:37.647957 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:29:37.647957 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:29:37.647957 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:29:37.647957 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:29:37.647957 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:29:37.647957 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:29:37.647957 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:29:37.648930 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:29:37.648930 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:29:37.648930 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 12:29:37.648930 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 12:29:37.648930 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 12:29:37.648930 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 12:29:37.648930 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 12:29:37.648930 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 12:29:37.648930 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 12:29:37.648930 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:29:37.648930 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 415/833] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:29:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:29:37.654730 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f236cf1-7441-4884-af0b-e74bbebee0f0 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:37.768015 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f236cf1-7441-4884-af0b-e74bbebee0f0 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:37.811680 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923932d-4e20-4376-9853-41f5ab3e0e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:37.812344 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923932d-4e20-4376-9853-41f5ab3e0e51 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:37.812623 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923932d-4e20-4376-9853-41f5ab3e0e51 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:37.812899 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923932d-4e20-4376-9853-41f5ab3e0e51 None admin] PATH_INFO: `/v3/users` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:37.813730 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923932d-4e20-4376-9853-41f5ab3e0e51 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:29:37.814031 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923932d-4e20-4376-9853-41f5ab3e0e51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:37.815740 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923932d-4e20-4376-9853-41f5ab3e0e51 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:37.835767 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 419/834] 10.222.0.55 () {56 vars in 1143 bytes} [Wed Jul 27 12:29:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:29:37.841272 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc88cbe-c34f-4d82-be7c-181c002a69a2 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:37.949566 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc88cbe-c34f-4d82-be7c-181c002a69a2 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:37.988097 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8eaf25-200b-4582-bc91-bdefd342398a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:37.989068 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8eaf25-200b-4582-bc91-bdefd342398a None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:37.989382 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8eaf25-200b-4582-bc91-bdefd342398a None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:37.989721 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8eaf25-200b-4582-bc91-bdefd342398a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:38.025345 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:38.067153 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8eaf25-200b-4582-bc91-bdefd342398a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:38.068600 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8eaf25-200b-4582-bc91-bdefd342398a None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:38.184663 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 416/835] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jul 27 12:29:37 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 12:29:38.190516 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923932d-4e20-4376-9853-41f5ab3e0e51 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:38.210579 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:38.296222 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923932d-4e20-4376-9853-41f5ab3e0e51 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:38.337339 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c3df7-0620-4148-bc32-65a3c12b2585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:38.338028 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c3df7-0620-4148-bc32-65a3c12b2585 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:38.338307 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c3df7-0620-4148-bc32-65a3c12b2585 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:38.338583 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c3df7-0620-4148-bc32-65a3c12b2585 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:38.348840 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c3df7-0620-4148-bc32-65a3c12b2585 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:38.350308 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c3df7-0620-4148-bc32-65a3c12b2585 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:38.366329 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-a88c3df7-0620-4148-bc32-65a3c12b2585 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:29:38.366329 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:29:38.366329 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:29:38.366329 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:29:38.366329 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:29:38.366329 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:29:38.366329 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:29:38.366329 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:29:38.366329 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:29:38.366329 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:29:38.366329 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:29:38.366329 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:29:38.366329 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:29:38.366329 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:29:38.366329 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:29:38.367710 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:29:38.367710 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:29:38.367710 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:29:38.367710 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:29:38.367710 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:29:38.367710 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:29:38.367710 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:29:38.367710 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:29:38.367710 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:29:38.367710 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:29:38.367710 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:29:38.367710 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:29:38.367710 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:29:38.367710 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:29:38.367710 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:29:38.367710 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:29:38.367710 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:29:38.368855 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:29:38.368855 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:29:38.368855 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:29:38.368855 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:29:38.372507 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 420/836] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:29:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:29:38.373482 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8eaf25-200b-4582-bc91-bdefd342398a None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:38.437043 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:38.479833 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8eaf25-200b-4582-bc91-bdefd342398a None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:38.518737 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6709a-13af-4498-a686-a95b43168662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:38.519397 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6709a-13af-4498-a686-a95b43168662 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:38.519691 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6709a-13af-4498-a686-a95b43168662 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:38.520034 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6709a-13af-4498-a686-a95b43168662 None admin] PATH_INFO: `/v3/domains` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:38.520821 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6709a-13af-4498-a686-a95b43168662 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:29:38.521163 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6709a-13af-4498-a686-a95b43168662 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:38.522641 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6709a-13af-4498-a686-a95b43168662 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:38.535260 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 417/837] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:29:38.540802 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c3df7-0620-4148-bc32-65a3c12b2585 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:38.616938 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:38.650944 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c3df7-0620-4148-bc32-65a3c12b2585 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:38.686993 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6766ba-f9a9-4347-8059-ca45e0e5604e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:38.688234 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6766ba-f9a9-4347-8059-ca45e0e5604e None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:38.688517 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6766ba-f9a9-4347-8059-ca45e0e5604e None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:38.688793 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6766ba-f9a9-4347-8059-ca45e0e5604e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:38.696560 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6766ba-f9a9-4347-8059-ca45e0e5604e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:38.698053 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6766ba-f9a9-4347-8059-ca45e0e5604e None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:38.711919 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-7f6766ba-f9a9-4347-8059-ca45e0e5604e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 12:29:38.711919 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:29:38.711919 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:29:38.711919 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:29:38.711919 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:29:38.711919 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:29:38.711919 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:29:38.711919 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:29:38.711919 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:29:38.711919 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:29:38.711919 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:29:38.711919 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:29:38.711919 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 12:29:38.711919 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 12:29:38.711919 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 12:29:38.713105 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 12:29:38.713105 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:29:38.713105 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:29:38.713105 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:29:38.713105 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:29:38.713105 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:29:38.713105 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:29:38.713105 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:29:38.713105 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:29:38.713105 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:29:38.713105 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:29:38.713105 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:29:38.713105 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:29:38.713105 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:29:38.713105 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:29:38.713105 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:29:38.713105 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:29:38.714077 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 12:29:38.714077 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 12:29:38.714077 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 12:29:38.714077 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 12:29:38.714077 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 12:29:38.714077 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 12:29:38.714077 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 12:29:38.714077 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:29:38.714077 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 421/838] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jul 27 12:29:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 12:29:38.719202 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6709a-13af-4498-a686-a95b43168662 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:38.826037 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6709a-13af-4498-a686-a95b43168662 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:38.844307 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:38.863397 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545bac04-6acc-4cc7-b142-95477e9fcd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:38.864021 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bac04-6acc-4cc7-b142-95477e9fcd4e None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:38.864287 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bac04-6acc-4cc7-b142-95477e9fcd4e None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:38.864566 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bac04-6acc-4cc7-b142-95477e9fcd4e None admin] PATH_INFO: `/v3/projects` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:38.865317 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545bac04-6acc-4cc7-b142-95477e9fcd4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:29:38.865655 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545bac04-6acc-4cc7-b142-95477e9fcd4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:38.867381 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545bac04-6acc-4cc7-b142-95477e9fcd4e None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:38.883154 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 418/839] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jul 27 12:29:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:29:38.889918 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6766ba-f9a9-4347-8059-ca45e0e5604e None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:39.008992 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6766ba-f9a9-4347-8059-ca45e0e5604e None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:39.042528 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:39.050295 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d6803-f240-427d-b725-b9a850220ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:39.050924 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d6803-f240-427d-b725-b9a850220ba8 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:39.051207 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d6803-f240-427d-b725-b9a850220ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:39.051482 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d6803-f240-427d-b725-b9a850220ba8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:39.052361 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d6803-f240-427d-b725-b9a850220ba8 None admin] RBAC: Adding query filter params (role.id=ec09bb8ea1664640a975563cc41cc39b, scope.project.id=e3316e9a169444ac827619608acc9fb7, user.id=6cc3f626dcb5495c9eed35a8e50092e9) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:29:39.052660 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d6803-f240-427d-b725-b9a850220ba8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:39.054125 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d6803-f240-427d-b725-b9a850220ba8 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:39.061792 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 422/840] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jul 27 12:29:38 2022] GET /identity/v3/role_assignments?user.id=6cc3f626dcb5495c9eed35a8e50092e9&scope.project.id=e3316e9a169444ac827619608acc9fb7&role.id=ec09bb8ea1664640a975563cc41cc39b => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:29:41.425269 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3e721-150b-4262-a473-4024c9c7468f None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:41.426057 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3e721-150b-4262-a473-4024c9c7468f None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:41.426057 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3e721-150b-4262-a473-4024c9c7468f None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:41.427351 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 419/841] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:29:41.432283 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175a032-23ec-4a60-98b7-a93ca0f9cccc None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:41.432664 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175a032-23ec-4a60-98b7-a93ca0f9cccc None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:41.432842 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175a032-23ec-4a60-98b7-a93ca0f9cccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:41.452811 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-7175a032-23ec-4a60-98b7-a93ca0f9cccc None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:29:41.454669 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-7175a032-23ec-4a60-98b7-a93ca0f9cccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:29:41.526113 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 423/842] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:29:41 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 12:29:41.550233 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3e721-150b-4262-a473-4024c9c7468f None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:41.655527 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3e721-150b-4262-a473-4024c9c7468f None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:41.699013 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ea37a-3820-4e05-bf55-1a5fc6034150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:41.699657 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ea37a-3820-4e05-bf55-1a5fc6034150 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:41.699938 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ea37a-3820-4e05-bf55-1a5fc6034150 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:41.700213 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ea37a-3820-4e05-bf55-1a5fc6034150 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:41.711199 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ea37a-3820-4e05-bf55-1a5fc6034150 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:29:41.716111 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-7b3ea37a-3820-4e05-bf55-1a5fc6034150 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 12:29:41.716111 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:29:41.716111 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:29:41.716111 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:29:41.716111 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:29:41.716111 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:29:41.716111 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:29:41.716111 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:29:41.716111 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:29:41.716111 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:29:41.716111 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:29:41.716111 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:29:41.716111 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:29:41.716111 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:29:41.716111 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:29:41.716111 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:29:41.717160 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:29:41.717160 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:29:41.717160 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:29:41.717160 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:29:41.717160 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:29:41.717160 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:29:41.717160 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:29:41.717160 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:29:41.717160 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:29:41.717160 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:29:41.717160 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:29:41.717160 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:29:41.717160 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:29:41.717160 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:29:41.717160 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:29:41.717160 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:29:41.718079 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:29:41.718079 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:29:41.718079 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:29:41.718079 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:29:41.718079 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:29:41.718079 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:29:41.718079 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:29:41.718079 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:29:41.718079 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:29:41.718079 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:29:41.718079 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 12:29:41.718079 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:29:41.718079 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 420/843] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jul 27 12:29:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:29:41.723387 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175a032-23ec-4a60-98b7-a93ca0f9cccc None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:41.831096 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175a032-23ec-4a60-98b7-a93ca0f9cccc None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:41.858992 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:41.871535 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24cd86-3a47-43db-831a-69eaeab2296d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:41.872334 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24cd86-3a47-43db-831a-69eaeab2296d None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:41.872619 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24cd86-3a47-43db-831a-69eaeab2296d None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:41.872917 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24cd86-3a47-43db-831a-69eaeab2296d None admin] PATH_INFO: `/v3/roles` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:41.874000 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac24cd86-3a47-43db-831a-69eaeab2296d None admin] RBAC: Adding query filter params (name=service) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:29:41.877124 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac24cd86-3a47-43db-831a-69eaeab2296d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:41.878968 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac24cd86-3a47-43db-831a-69eaeab2296d None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:41.888722 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 424/844] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jul 27 12:29:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:29:41.895197 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ea37a-3820-4e05-bf55-1a5fc6034150 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:41.938707 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:42.014516 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ea37a-3820-4e05-bf55-1a5fc6034150 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:42.058382 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc99a53-71c9-4a13-9ad1-0f1eceddfd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:42.059105 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc99a53-71c9-4a13-9ad1-0f1eceddfd5a None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:42.059395 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc99a53-71c9-4a13-9ad1-0f1eceddfd5a None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:42.059712 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc99a53-71c9-4a13-9ad1-0f1eceddfd5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:42.072290 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc99a53-71c9-4a13-9ad1-0f1eceddfd5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:42.073952 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc99a53-71c9-4a13-9ad1-0f1eceddfd5a None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:42.090462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-6dc99a53-71c9-4a13-9ad1-0f1eceddfd5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:29:42.090462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:29:42.090462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:29:42.090462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:29:42.090462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:29:42.090462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:29:42.090462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:29:42.090462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:29:42.090462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:29:42.090462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:29:42.090462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:29:42.090462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:29:42.090462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:29:42.090462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:29:42.090462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:29:42.091436 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:29:42.091436 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:29:42.091436 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:29:42.091436 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:29:42.091436 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:29:42.091436 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:29:42.091436 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:29:42.091436 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:29:42.091436 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:29:42.091436 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:29:42.091436 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:29:42.091436 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:29:42.091436 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:29:42.091436 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:29:42.091436 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:29:42.091436 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:29:42.091436 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:29:42.092358 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:29:42.092358 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:29:42.092358 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:29:42.092358 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:29:42.092358 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 421/845] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:29:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:29:42.098572 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24cd86-3a47-43db-831a-69eaeab2296d None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:42.210716 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24cd86-3a47-43db-831a-69eaeab2296d None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:42.247602 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4921339-28c0-4a3a-8748-6ae5fc6ed3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:42.248460 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4921339-28c0-4a3a-8748-6ae5fc6ed3c5 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:42.248613 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4921339-28c0-4a3a-8748-6ae5fc6ed3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:42.248942 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4921339-28c0-4a3a-8748-6ae5fc6ed3c5 None admin] PATH_INFO: `/v3/domains` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:42.250376 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4921339-28c0-4a3a-8748-6ae5fc6ed3c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:29:42.250708 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4921339-28c0-4a3a-8748-6ae5fc6ed3c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:42.252443 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4921339-28c0-4a3a-8748-6ae5fc6ed3c5 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:42.266349 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 425/846] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:29:42.272980 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc99a53-71c9-4a13-9ad1-0f1eceddfd5a None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:42.388857 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:42.398657 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc99a53-71c9-4a13-9ad1-0f1eceddfd5a None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:42.432870 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9ff1a-ebbb-45f8-8a83-cb5175ace968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:42.433511 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9ff1a-ebbb-45f8-8a83-cb5175ace968 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:42.433813 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9ff1a-ebbb-45f8-8a83-cb5175ace968 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:42.434089 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9ff1a-ebbb-45f8-8a83-cb5175ace968 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:42.442172 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde9ff1a-ebbb-45f8-8a83-cb5175ace968 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:42.443614 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde9ff1a-ebbb-45f8-8a83-cb5175ace968 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:42.455579 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-dde9ff1a-ebbb-45f8-8a83-cb5175ace968 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 12:29:42.455579 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:29:42.455579 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:29:42.455579 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:29:42.455579 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:29:42.455579 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:29:42.455579 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:29:42.455579 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:29:42.455579 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:29:42.455579 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:29:42.455579 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:29:42.455579 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:29:42.455579 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 12:29:42.455579 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 12:29:42.455579 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 12:29:42.455579 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 12:29:42.456997 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:29:42.456997 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:29:42.456997 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 12:29:42.456997 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:29:42.456997 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 12:29:42.456997 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:29:42.456997 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:29:42.456997 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:29:42.456997 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:29:42.456997 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:29:42.456997 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:29:42.456997 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:29:42.456997 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:29:42.456997 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:29:42.456997 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:29:42.456997 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:29:42.456997 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:29:42.456997 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:29:42.458763 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:29:42.458763 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:29:42.458763 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 12:29:42.458763 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 12:29:42.458763 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 12:29:42.458763 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 12:29:42.458763 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 12:29:42.458763 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 12:29:42.458763 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 12:29:42.458763 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:29:42.458763 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 422/847] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:29:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:29:42.463548 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4921339-28c0-4a3a-8748-6ae5fc6ed3c5 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:42.511832 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:42.570284 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4921339-28c0-4a3a-8748-6ae5fc6ed3c5 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:42.608888 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5c171-43f8-4713-b38c-195fb167f7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:42.610274 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5c171-43f8-4713-b38c-195fb167f7e9 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:42.610555 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5c171-43f8-4713-b38c-195fb167f7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:42.610837 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5c171-43f8-4713-b38c-195fb167f7e9 None admin] PATH_INFO: `/v3/users` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:42.611683 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf5c171-43f8-4713-b38c-195fb167f7e9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:29:42.611931 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf5c171-43f8-4713-b38c-195fb167f7e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:42.613373 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf5c171-43f8-4713-b38c-195fb167f7e9 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:42.631211 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 426/848] 10.222.0.55 () {56 vars in 1143 bytes} [Wed Jul 27 12:29:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:29:42.637117 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9ff1a-ebbb-45f8-8a83-cb5175ace968 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:42.751196 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9ff1a-ebbb-45f8-8a83-cb5175ace968 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:42.790242 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b17b5-03ac-49c3-be99-3762fcad3ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:42.790977 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b17b5-03ac-49c3-be99-3762fcad3ad5 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:42.791295 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b17b5-03ac-49c3-be99-3762fcad3ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:42.791621 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b17b5-03ac-49c3-be99-3762fcad3ad5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:42.804344 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b17b5-03ac-49c3-be99-3762fcad3ad5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:42.805842 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b17b5-03ac-49c3-be99-3762fcad3ad5 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:42.824472 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-c62b17b5-03ac-49c3-be99-3762fcad3ad5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:29:42.824472 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:29:42.824472 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:29:42.824472 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:29:42.824472 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:29:42.824472 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:29:42.824472 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:29:42.824472 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:29:42.824472 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:29:42.824472 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:29:42.824472 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:29:42.824472 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:29:42.824472 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:29:42.824472 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:29:42.824472 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:29:42.825663 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:29:42.825663 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:29:42.825663 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:29:42.825663 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:29:42.825663 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:29:42.825663 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:29:42.825663 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:29:42.825663 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:29:42.825663 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:29:42.825663 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:29:42.825663 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:29:42.825663 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:29:42.825663 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:29:42.825663 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:29:42.825663 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:29:42.825663 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:29:42.825663 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:29:42.826596 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:29:42.826596 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:29:42.826596 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:29:42.826596 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:29:42.826596 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 423/849] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:29:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:29:42.832097 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5c171-43f8-4713-b38c-195fb167f7e9 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:42.945524 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5c171-43f8-4713-b38c-195fb167f7e9 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:42.948031 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:42.985071 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816cc183-d28e-4fab-8aa8-d3ee4d3a5afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:42.985738 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816cc183-d28e-4fab-8aa8-d3ee4d3a5afa None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:42.986042 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816cc183-d28e-4fab-8aa8-d3ee4d3a5afa None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:42.986323 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816cc183-d28e-4fab-8aa8-d3ee4d3a5afa None admin] PATH_INFO: `/v3/domains` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:42.987425 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816cc183-d28e-4fab-8aa8-d3ee4d3a5afa None admin] RBAC: Adding query filter params (name=Default) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:29:42.987777 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816cc183-d28e-4fab-8aa8-d3ee4d3a5afa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:42.989433 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816cc183-d28e-4fab-8aa8-d3ee4d3a5afa None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:43.002414 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 427/850] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:29:43.008254 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b17b5-03ac-49c3-be99-3762fcad3ad5 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:43.011182 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:43.124578 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b17b5-03ac-49c3-be99-3762fcad3ad5 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:43.159904 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac013ea-6249-42fc-9cea-5cf8b9f56c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:43.160543 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac013ea-6249-42fc-9cea-5cf8b9f56c41 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:43.160824 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac013ea-6249-42fc-9cea-5cf8b9f56c41 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:43.161101 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac013ea-6249-42fc-9cea-5cf8b9f56c41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:43.168189 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac013ea-6249-42fc-9cea-5cf8b9f56c41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:43.169873 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac013ea-6249-42fc-9cea-5cf8b9f56c41 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:43.183918 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-4ac013ea-6249-42fc-9cea-5cf8b9f56c41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 12:29:43.183918 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:29:43.183918 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:29:43.183918 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:29:43.183918 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:29:43.183918 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:29:43.183918 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:29:43.183918 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:29:43.183918 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:29:43.183918 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:29:43.183918 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:29:43.183918 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:29:43.183918 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 12:29:43.183918 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 12:29:43.183918 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 12:29:43.185105 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 12:29:43.185105 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:29:43.185105 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:29:43.185105 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:29:43.185105 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:29:43.185105 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:29:43.185105 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:29:43.185105 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:29:43.185105 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:29:43.185105 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:29:43.185105 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:29:43.185105 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:29:43.185105 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:29:43.185105 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:29:43.185105 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:29:43.185105 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:29:43.185105 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:29:43.186146 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 12:29:43.186146 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 12:29:43.186146 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 12:29:43.186146 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 12:29:43.186146 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 12:29:43.186146 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 12:29:43.186146 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 12:29:43.186146 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:29:43.186146 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 424/851] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jul 27 12:29:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 12:29:43.193862 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816cc183-d28e-4fab-8aa8-d3ee4d3a5afa None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:43.316050 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816cc183-d28e-4fab-8aa8-d3ee4d3a5afa None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:43.354506 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4292f1-d133-4a41-8827-26f1739cc781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:43.355157 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4292f1-d133-4a41-8827-26f1739cc781 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:43.355469 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4292f1-d133-4a41-8827-26f1739cc781 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:43.355749 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4292f1-d133-4a41-8827-26f1739cc781 None admin] PATH_INFO: `/v3/projects` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:43.356622 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4292f1-d133-4a41-8827-26f1739cc781 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:29:43.356974 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4292f1-d133-4a41-8827-26f1739cc781 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:43.358538 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4292f1-d133-4a41-8827-26f1739cc781 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:43.371669 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 428/852] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jul 27 12:29:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:29:43.378277 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac013ea-6249-42fc-9cea-5cf8b9f56c41 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:43.442299 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:43.489472 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac013ea-6249-42fc-9cea-5cf8b9f56c41 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:43.525994 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58292c2-39a8-4b5e-a0d9-8f91b9b450e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:43.526712 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58292c2-39a8-4b5e-a0d9-8f91b9b450e7 None admin] REQUEST_METHOD: `PUT` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:43.527024 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58292c2-39a8-4b5e-a0d9-8f91b9b450e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:43.527306 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58292c2-39a8-4b5e-a0d9-8f91b9b450e7 None admin] PATH_INFO: `/v3/projects/e3316e9a169444ac827619608acc9fb7/users/6cc3f626dcb5495c9eed35a8e50092e9/roles/ec09bb8ea1664640a975563cc41cc39b` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:43.542787 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58292c2-39a8-4b5e-a0d9-8f91b9b450e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3316e9a169444ac827619608acc9fb7, user_id=6cc3f626dcb5495c9eed35a8e50092e9, role_id=ec09bb8ea1664640a975563cc41cc39b)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:43.544221 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58292c2-39a8-4b5e-a0d9-8f91b9b450e7 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:43.556627 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 425/853] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jul 27 12:29:43 2022] PUT /identity/v3/projects/e3316e9a169444ac827619608acc9fb7/users/6cc3f626dcb5495c9eed35a8e50092e9/roles/ec09bb8ea1664640a975563cc41cc39b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 12:29:45.842990 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab4574-af9d-4ed5-9cd4-09d3a354cb80 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:45.844070 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab4574-af9d-4ed5-9cd4-09d3a354cb80 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:45.844070 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab4574-af9d-4ed5-9cd4-09d3a354cb80 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:45.845400 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 429/854] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:29:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:29:45.850708 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646959c8-89eb-46c4-8bcc-886e3dea8e10 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:45.851188 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646959c8-89eb-46c4-8bcc-886e3dea8e10 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:45.851412 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646959c8-89eb-46c4-8bcc-886e3dea8e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:45.871146 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-646959c8-89eb-46c4-8bcc-886e3dea8e10 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:29:45.872347 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-646959c8-89eb-46c4-8bcc-886e3dea8e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:29:45.946255 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 426/855] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:29:45 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 12:29:45.970486 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab4574-af9d-4ed5-9cd4-09d3a354cb80 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:45.996805 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:46.088766 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab4574-af9d-4ed5-9cd4-09d3a354cb80 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:46.132308 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234a0ca-6adc-4726-85da-fb4f2848a8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:46.133372 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234a0ca-6adc-4726-85da-fb4f2848a8e9 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:46.133911 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234a0ca-6adc-4726-85da-fb4f2848a8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:46.134402 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234a0ca-6adc-4726-85da-fb4f2848a8e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:46.154118 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d234a0ca-6adc-4726-85da-fb4f2848a8e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:29:46.163928 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-d234a0ca-6adc-4726-85da-fb4f2848a8e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 12:29:46.163928 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:29:46.163928 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:29:46.163928 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:29:46.163928 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:29:46.163928 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:29:46.163928 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:29:46.163928 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:29:46.163928 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:29:46.163928 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:29:46.163928 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:29:46.163928 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:29:46.163928 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:29:46.163928 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:29:46.163928 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:29:46.163928 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:29:46.165054 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:29:46.165054 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:29:46.165054 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:29:46.165054 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:29:46.165054 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:29:46.165054 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:29:46.165054 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:29:46.165054 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:29:46.165054 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:29:46.165054 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:29:46.165054 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:29:46.165054 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:29:46.165054 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:29:46.165054 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:29:46.165054 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:29:46.165054 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:29:46.166006 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:29:46.166006 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:29:46.166006 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:29:46.166006 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:29:46.166006 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:29:46.166006 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:29:46.166006 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:29:46.166006 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:29:46.166006 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:29:46.166006 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:29:46.166006 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 12:29:46.166006 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:29:46.166006 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 430/856] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Jul 27 12:29:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:29:46.174450 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646959c8-89eb-46c4-8bcc-886e3dea8e10 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:46.226709 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:46.298806 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646959c8-89eb-46c4-8bcc-886e3dea8e10 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:46.343182 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc9bd1-4ac3-4b2a-8deb-e1457b49e415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:46.343877 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc9bd1-4ac3-4b2a-8deb-e1457b49e415 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:46.344166 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc9bd1-4ac3-4b2a-8deb-e1457b49e415 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:46.344448 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc9bd1-4ac3-4b2a-8deb-e1457b49e415 None admin] PATH_INFO: `/v3/roles` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:46.345447 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc9bd1-4ac3-4b2a-8deb-e1457b49e415 None admin] RBAC: Adding query filter params (name=service) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:29:46.345783 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc9bd1-4ac3-4b2a-8deb-e1457b49e415 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:46.347153 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc9bd1-4ac3-4b2a-8deb-e1457b49e415 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:46.357771 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 427/857] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Jul 27 12:29:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:29:46.364672 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234a0ca-6adc-4726-85da-fb4f2848a8e9 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:46.464368 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:46.483576 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234a0ca-6adc-4726-85da-fb4f2848a8e9 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:46.521440 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd00af-04d8-4529-a55f-c32a8b6f4ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:46.522116 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd00af-04d8-4529-a55f-c32a8b6f4ff2 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:46.522402 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd00af-04d8-4529-a55f-c32a8b6f4ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:46.522683 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd00af-04d8-4529-a55f-c32a8b6f4ff2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:46.532608 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd00af-04d8-4529-a55f-c32a8b6f4ff2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:46.534270 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd00af-04d8-4529-a55f-c32a8b6f4ff2 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:46.549731 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-6ecd00af-04d8-4529-a55f-c32a8b6f4ff2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:29:46.549731 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:29:46.549731 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:29:46.549731 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:29:46.549731 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:29:46.549731 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:29:46.549731 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:29:46.549731 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:29:46.549731 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:29:46.549731 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:29:46.549731 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:29:46.549731 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:29:46.549731 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:29:46.549731 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:29:46.549731 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:29:46.550918 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:29:46.550918 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:29:46.550918 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:29:46.550918 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:29:46.550918 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:29:46.550918 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:29:46.550918 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:29:46.550918 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:29:46.550918 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:29:46.550918 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:29:46.550918 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:29:46.550918 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:29:46.550918 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:29:46.550918 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:29:46.550918 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:29:46.550918 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:29:46.550918 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:29:46.551925 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:29:46.551925 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:29:46.551925 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:29:46.551925 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:29:46.551925 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 431/858] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:29:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:29:46.558417 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc9bd1-4ac3-4b2a-8deb-e1457b49e415 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:46.675761 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc9bd1-4ac3-4b2a-8deb-e1457b49e415 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:46.678162 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:46.719431 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43d7c6-574c-45a1-9d8c-96233f60aa18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:46.719431 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43d7c6-574c-45a1-9d8c-96233f60aa18 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:46.719431 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43d7c6-574c-45a1-9d8c-96233f60aa18 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:46.719431 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43d7c6-574c-45a1-9d8c-96233f60aa18 None admin] PATH_INFO: `/v3/domains` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:46.719968 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e43d7c6-574c-45a1-9d8c-96233f60aa18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:29:46.719968 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e43d7c6-574c-45a1-9d8c-96233f60aa18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:46.721235 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e43d7c6-574c-45a1-9d8c-96233f60aa18 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:46.735014 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 428/859] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:29:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:29:46.740846 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd00af-04d8-4529-a55f-c32a8b6f4ff2 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:46.858254 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd00af-04d8-4529-a55f-c32a8b6f4ff2 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:46.897425 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71db5ac-2e7d-4e50-b542-ebddb79c0ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:46.898226 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71db5ac-2e7d-4e50-b542-ebddb79c0ec3 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:46.898575 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71db5ac-2e7d-4e50-b542-ebddb79c0ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:46.898892 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71db5ac-2e7d-4e50-b542-ebddb79c0ec3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:46.902231 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:46.909811 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71db5ac-2e7d-4e50-b542-ebddb79c0ec3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:46.911766 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71db5ac-2e7d-4e50-b542-ebddb79c0ec3 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:46.925157 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-d71db5ac-2e7d-4e50-b542-ebddb79c0ec3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 12:29:46.925157 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:29:46.925157 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:29:46.925157 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:29:46.925157 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:29:46.925157 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:29:46.925157 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:29:46.925157 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:29:46.925157 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:29:46.925157 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:29:46.925157 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:29:46.925157 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:29:46.925157 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 12:29:46.925157 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 12:29:46.925157 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 12:29:46.925157 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 12:29:46.926309 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:29:46.926309 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:29:46.926309 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 12:29:46.926309 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:29:46.926309 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 12:29:46.926309 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:29:46.926309 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:29:46.926309 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:29:46.926309 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:29:46.926309 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:29:46.926309 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:29:46.926309 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:29:46.926309 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:29:46.926309 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:29:46.926309 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:29:46.926309 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:29:46.926309 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:29:46.926309 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:29:46.927287 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:29:46.927287 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:29:46.927287 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 12:29:46.927287 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 12:29:46.927287 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 12:29:46.927287 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 12:29:46.927287 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 12:29:46.927287 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 12:29:46.927287 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 12:29:46.927287 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:29:46.927287 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 432/860] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:29:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:29:46.933223 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43d7c6-574c-45a1-9d8c-96233f60aa18 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:47.035739 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43d7c6-574c-45a1-9d8c-96233f60aa18 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:47.068614 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2da3c-39b4-499b-939a-2e4db3c23895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:47.069222 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2da3c-39b4-499b-939a-2e4db3c23895 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:47.069499 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2da3c-39b4-499b-939a-2e4db3c23895 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:47.069797 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2da3c-39b4-499b-939a-2e4db3c23895 None admin] PATH_INFO: `/v3/users` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:47.070583 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2da3c-39b4-499b-939a-2e4db3c23895 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:29:47.070887 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2da3c-39b4-499b-939a-2e4db3c23895 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:47.072364 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2da3c-39b4-499b-939a-2e4db3c23895 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:47.090521 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 429/861] 10.222.0.55 () {56 vars in 1143 bytes} [Wed Jul 27 12:29:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:29:47.097670 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71db5ac-2e7d-4e50-b542-ebddb79c0ec3 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:47.208578 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71db5ac-2e7d-4e50-b542-ebddb79c0ec3 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:47.244092 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68395139-10a5-4232-9ab8-05d042d2e57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:47.245367 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68395139-10a5-4232-9ab8-05d042d2e57f None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:47.245367 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68395139-10a5-4232-9ab8-05d042d2e57f None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:47.246297 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68395139-10a5-4232-9ab8-05d042d2e57f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:47.321909 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:47.330029 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68395139-10a5-4232-9ab8-05d042d2e57f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:47.331631 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68395139-10a5-4232-9ab8-05d042d2e57f None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:47.452629 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 433/862] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jul 27 12:29:47 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 12:29:47.458921 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2da3c-39b4-499b-939a-2e4db3c23895 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:47.488850 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:47.569853 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2da3c-39b4-499b-939a-2e4db3c23895 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:47.606534 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806fc1a6-2d0b-4e2a-a3f7-bb251c90313f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:47.607101 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806fc1a6-2d0b-4e2a-a3f7-bb251c90313f None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:47.607389 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806fc1a6-2d0b-4e2a-a3f7-bb251c90313f None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:47.607661 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806fc1a6-2d0b-4e2a-a3f7-bb251c90313f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:47.618509 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806fc1a6-2d0b-4e2a-a3f7-bb251c90313f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:47.620264 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806fc1a6-2d0b-4e2a-a3f7-bb251c90313f None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:47.635445 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-806fc1a6-2d0b-4e2a-a3f7-bb251c90313f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:29:47.635445 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:29:47.635445 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:29:47.635445 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:29:47.635445 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:29:47.635445 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:29:47.635445 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:29:47.635445 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:29:47.635445 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:29:47.635445 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:29:47.635445 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:29:47.635445 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:29:47.635445 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:29:47.635445 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:29:47.635445 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:29:47.636794 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:29:47.636794 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:29:47.636794 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:29:47.636794 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:29:47.636794 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:29:47.636794 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:29:47.636794 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:29:47.636794 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:29:47.636794 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:29:47.636794 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:29:47.636794 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:29:47.636794 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:29:47.636794 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:29:47.636794 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:29:47.636794 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:29:47.636794 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:29:47.636794 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:29:47.638081 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:29:47.638081 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:29:47.638081 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:29:47.638081 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:29:47.638081 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 430/863] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:29:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 12:29:47.644025 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68395139-10a5-4232-9ab8-05d042d2e57f None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:47.753489 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:47.759707 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68395139-10a5-4232-9ab8-05d042d2e57f None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:47.798755 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9db73-be28-4697-a625-97c76ccd7251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:47.799383 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9db73-be28-4697-a625-97c76ccd7251 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:47.799662 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9db73-be28-4697-a625-97c76ccd7251 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:47.799939 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9db73-be28-4697-a625-97c76ccd7251 None admin] PATH_INFO: `/v3/domains` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:47.800632 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9db73-be28-4697-a625-97c76ccd7251 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:29:47.800929 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9db73-be28-4697-a625-97c76ccd7251 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:47.802341 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9db73-be28-4697-a625-97c76ccd7251 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:47.813877 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 434/864] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:29:47.819710 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806fc1a6-2d0b-4e2a-a3f7-bb251c90313f None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:47.903702 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:47.932617 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806fc1a6-2d0b-4e2a-a3f7-bb251c90313f None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:47.969210 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc307b6-4a30-4c63-8d55-27d0c25b85aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:47.969980 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc307b6-4a30-4c63-8d55-27d0c25b85aa None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:47.970267 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc307b6-4a30-4c63-8d55-27d0c25b85aa None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:47.970663 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc307b6-4a30-4c63-8d55-27d0c25b85aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:47.978407 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc307b6-4a30-4c63-8d55-27d0c25b85aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:47.980034 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc307b6-4a30-4c63-8d55-27d0c25b85aa None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:47.994089 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-8cc307b6-4a30-4c63-8d55-27d0c25b85aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 12:29:47.994089 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:29:47.994089 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:29:47.994089 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:29:47.994089 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:29:47.994089 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:29:47.994089 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:29:47.994089 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:29:47.994089 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:29:47.994089 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:29:47.994089 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:29:47.994089 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:29:47.994089 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 12:29:47.994089 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 12:29:47.994089 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 12:29:47.995208 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 12:29:47.995208 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:29:47.995208 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:29:47.995208 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:29:47.995208 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:29:47.995208 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:29:47.995208 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:29:47.995208 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:29:47.995208 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:29:47.995208 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:29:47.995208 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:29:47.995208 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:29:47.995208 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:29:47.995208 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:29:47.995208 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:29:47.995208 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:29:47.995208 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:29:47.996311 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 12:29:47.996311 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 12:29:47.996311 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 12:29:47.996311 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 12:29:47.996311 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 12:29:47.996311 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 12:29:47.996311 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 12:29:47.996311 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:29:47.996311 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 431/865] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jul 27 12:29:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 12:29:48.001764 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9db73-be28-4697-a625-97c76ccd7251 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:48.122774 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9db73-be28-4697-a625-97c76ccd7251 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:48.172669 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafcfc8a-8a53-4517-969c-fd32c470b167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:48.173878 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafcfc8a-8a53-4517-969c-fd32c470b167 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:48.174357 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafcfc8a-8a53-4517-969c-fd32c470b167 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:48.174863 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafcfc8a-8a53-4517-969c-fd32c470b167 None admin] PATH_INFO: `/v3/projects` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:48.176151 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafcfc8a-8a53-4517-969c-fd32c470b167 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:29:48.176578 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafcfc8a-8a53-4517-969c-fd32c470b167 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:48.178557 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafcfc8a-8a53-4517-969c-fd32c470b167 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:48.197950 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 435/866] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jul 27 12:29:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:29:48.206711 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc307b6-4a30-4c63-8d55-27d0c25b85aa None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:48.338368 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc307b6-4a30-4c63-8d55-27d0c25b85aa None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:48.379063 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ed95e-93fc-444e-9120-94bc762b1046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:48.379672 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ed95e-93fc-444e-9120-94bc762b1046 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:48.380081 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ed95e-93fc-444e-9120-94bc762b1046 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:48.380477 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ed95e-93fc-444e-9120-94bc762b1046 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:48.381366 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ed95e-93fc-444e-9120-94bc762b1046 None admin] RBAC: Adding query filter params (role.id=ec09bb8ea1664640a975563cc41cc39b, scope.project.id=e3316e9a169444ac827619608acc9fb7, user.id=6cc3f626dcb5495c9eed35a8e50092e9) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:29:48.381835 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ed95e-93fc-444e-9120-94bc762b1046 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:48.383720 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ed95e-93fc-444e-9120-94bc762b1046 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:48.385904 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:48.400621 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 432/867] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jul 27 12:29:48 2022] GET /identity/v3/role_assignments?user.id=6cc3f626dcb5495c9eed35a8e50092e9&scope.project.id=e3316e9a169444ac827619608acc9fb7&role.id=ec09bb8ea1664640a975563cc41cc39b => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:29:51.104332 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb499a-0a4c-4d7a-ba9d-07224137af7b None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:51.105012 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb499a-0a4c-4d7a-ba9d-07224137af7b None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:51.105012 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb499a-0a4c-4d7a-ba9d-07224137af7b None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:51.106332 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 436/868] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:29:51.112708 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5882c-ff68-4c77-a770-bc2eb9decf62 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:51.113313 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5882c-ff68-4c77-a770-bc2eb9decf62 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:51.113313 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5882c-ff68-4c77-a770-bc2eb9decf62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:51.133573 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-7ea5882c-ff68-4c77-a770-bc2eb9decf62 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:29:51.135023 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-7ea5882c-ff68-4c77-a770-bc2eb9decf62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:29:51.213025 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 433/869] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:29:51 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 12:29:51.242546 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb499a-0a4c-4d7a-ba9d-07224137af7b None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:51.262641 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:51.361966 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb499a-0a4c-4d7a-ba9d-07224137af7b None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:51.403429 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c8a13-292e-42a2-ac9f-4267e3b7e6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:51.404079 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c8a13-292e-42a2-ac9f-4267e3b7e6e4 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:51.404356 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c8a13-292e-42a2-ac9f-4267e3b7e6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:51.404628 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c8a13-292e-42a2-ac9f-4267e3b7e6e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:51.415591 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c8a13-292e-42a2-ac9f-4267e3b7e6e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:29:51.420521 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-776c8a13-292e-42a2-ac9f-4267e3b7e6e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 12:29:51.420521 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:29:51.420521 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:29:51.420521 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:29:51.420521 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:29:51.420521 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:29:51.420521 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:29:51.420521 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:29:51.420521 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:29:51.420521 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:29:51.420521 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:29:51.420521 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:29:51.420521 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:29:51.420521 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:29:51.420521 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:29:51.420521 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:29:51.422238 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:29:51.422238 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:29:51.422238 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:29:51.422238 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:29:51.422238 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:29:51.422238 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:29:51.422238 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:29:51.422238 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:29:51.422238 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:29:51.422238 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:29:51.422238 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:29:51.422238 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:29:51.422238 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:29:51.422238 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:29:51.422238 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:29:51.422238 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:29:51.423117 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:29:51.423117 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:29:51.423117 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:29:51.423117 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:29:51.423117 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:29:51.423117 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:29:51.423117 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:29:51.423117 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:29:51.423117 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:29:51.423117 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:29:51.423117 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 12:29:51.423117 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:29:51.423117 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 437/870] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jul 27 12:29:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:29:51.428343 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5882c-ff68-4c77-a770-bc2eb9decf62 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:51.541451 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5882c-ff68-4c77-a770-bc2eb9decf62 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:51.572041 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:51.580258 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35dcac-330b-4f8f-988f-796b858b71e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:51.580832 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35dcac-330b-4f8f-988f-796b858b71e0 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:51.581205 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35dcac-330b-4f8f-988f-796b858b71e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:51.581431 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35dcac-330b-4f8f-988f-796b858b71e0 None admin] PATH_INFO: `/v3/roles` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:51.582174 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35dcac-330b-4f8f-988f-796b858b71e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:29:51.582483 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35dcac-330b-4f8f-988f-796b858b71e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:51.583836 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35dcac-330b-4f8f-988f-796b858b71e0 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:51.592153 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 434/871] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:29:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:29:51.598175 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c8a13-292e-42a2-ac9f-4267e3b7e6e4 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:51.692788 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:51.716592 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c8a13-292e-42a2-ac9f-4267e3b7e6e4 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:51.752139 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f1e31-7b9b-4d2a-8816-ecb638a8b72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:51.752790 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f1e31-7b9b-4d2a-8816-ecb638a8b72d None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:51.753078 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f1e31-7b9b-4d2a-8816-ecb638a8b72d None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:51.753392 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f1e31-7b9b-4d2a-8816-ecb638a8b72d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:51.763660 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f1e31-7b9b-4d2a-8816-ecb638a8b72d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:51.765754 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f1e31-7b9b-4d2a-8816-ecb638a8b72d None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:51.780547 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-ea6f1e31-7b9b-4d2a-8816-ecb638a8b72d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:29:51.780547 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:29:51.780547 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:29:51.780547 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:29:51.780547 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:29:51.780547 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:29:51.780547 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:29:51.780547 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:29:51.780547 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:29:51.780547 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:29:51.780547 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:29:51.780547 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:29:51.780547 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:29:51.780547 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:29:51.780547 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:29:51.781497 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:29:51.781497 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:29:51.781497 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:29:51.781497 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:29:51.781497 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:29:51.781497 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:29:51.781497 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:29:51.781497 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:29:51.781497 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:29:51.781497 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:29:51.781497 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:29:51.781497 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:29:51.781497 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:29:51.781497 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:29:51.781497 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:29:51.781497 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:29:51.781497 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:29:51.783229 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:29:51.783229 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:29:51.783229 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:29:51.783229 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:29:51.783229 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 438/872] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:29:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:29:51.787610 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35dcac-330b-4f8f-988f-796b858b71e0 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:51.889772 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35dcac-330b-4f8f-988f-796b858b71e0 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:51.925306 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a2f98-c2c3-4a4d-af41-ff44a7c40051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:51.925951 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a2f98-c2c3-4a4d-af41-ff44a7c40051 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:51.926232 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a2f98-c2c3-4a4d-af41-ff44a7c40051 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:51.926505 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a2f98-c2c3-4a4d-af41-ff44a7c40051 None admin] PATH_INFO: `/v3/domains` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:51.927192 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a2f98-c2c3-4a4d-af41-ff44a7c40051 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:29:51.927500 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a2f98-c2c3-4a4d-af41-ff44a7c40051 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:51.928890 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a2f98-c2c3-4a4d-af41-ff44a7c40051 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:51.941267 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 435/873] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:29:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:29:51.947021 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f1e31-7b9b-4d2a-8816-ecb638a8b72d None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:52.062909 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f1e31-7b9b-4d2a-8816-ecb638a8b72d None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:52.094250 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:52.103785 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7830aa-b4d4-439d-9e6b-340e5f4791d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:52.104553 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7830aa-b4d4-439d-9e6b-340e5f4791d4 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:52.105102 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7830aa-b4d4-439d-9e6b-340e5f4791d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:52.105102 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7830aa-b4d4-439d-9e6b-340e5f4791d4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:52.113569 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7830aa-b4d4-439d-9e6b-340e5f4791d4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:52.115080 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7830aa-b4d4-439d-9e6b-340e5f4791d4 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:52.127450 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-ae7830aa-b4d4-439d-9e6b-340e5f4791d4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 12:29:52.127450 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:29:52.127450 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:29:52.127450 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:29:52.127450 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:29:52.127450 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:29:52.127450 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:29:52.127450 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:29:52.127450 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:29:52.127450 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:29:52.127450 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:29:52.127450 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:29:52.127450 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 12:29:52.127450 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 12:29:52.127450 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 12:29:52.127450 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 12:29:52.128493 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:29:52.128493 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:29:52.128493 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 12:29:52.128493 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:29:52.128493 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 12:29:52.128493 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:29:52.128493 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:29:52.128493 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:29:52.128493 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:29:52.128493 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:29:52.128493 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:29:52.128493 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:29:52.128493 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:29:52.128493 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:29:52.128493 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:29:52.128493 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:29:52.128493 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:29:52.128493 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:29:52.129494 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:29:52.129494 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:29:52.129494 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 12:29:52.129494 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 12:29:52.129494 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 12:29:52.129494 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 12:29:52.129494 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 12:29:52.129494 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 12:29:52.129494 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 12:29:52.129494 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:29:52.129494 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 439/874] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:29:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:29:52.134711 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a2f98-c2c3-4a4d-af41-ff44a7c40051 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:52.188109 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:52.240817 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a2f98-c2c3-4a4d-af41-ff44a7c40051 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:52.279349 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e04cac-a6a0-48f1-bc12-66c5dcae915e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:52.280307 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e04cac-a6a0-48f1-bc12-66c5dcae915e None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:52.280727 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e04cac-a6a0-48f1-bc12-66c5dcae915e None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:52.281013 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e04cac-a6a0-48f1-bc12-66c5dcae915e None admin] PATH_INFO: `/v3/users` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:52.282226 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e04cac-a6a0-48f1-bc12-66c5dcae915e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:29:52.282622 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e04cac-a6a0-48f1-bc12-66c5dcae915e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:52.284659 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e04cac-a6a0-48f1-bc12-66c5dcae915e None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:52.306412 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 436/875] 10.222.0.55 () {56 vars in 1143 bytes} [Wed Jul 27 12:29:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:29:52.314277 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7830aa-b4d4-439d-9e6b-340e5f4791d4 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:52.434807 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7830aa-b4d4-439d-9e6b-340e5f4791d4 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:52.483482 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe8720-5457-4a4c-97ee-e2989ccbe577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:52.484744 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe8720-5457-4a4c-97ee-e2989ccbe577 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:52.485035 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe8720-5457-4a4c-97ee-e2989ccbe577 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:52.485312 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe8720-5457-4a4c-97ee-e2989ccbe577 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:52.556805 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:52.569645 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fe8720-5457-4a4c-97ee-e2989ccbe577 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:52.571114 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fe8720-5457-4a4c-97ee-e2989ccbe577 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:52.676263 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 440/876] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jul 27 12:29:52 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 12:29:52.682195 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e04cac-a6a0-48f1-bc12-66c5dcae915e None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:52.787980 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e04cac-a6a0-48f1-bc12-66c5dcae915e None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:52.798899 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:52.825418 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d610456-d6aa-4328-b320-cec443448d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:52.826062 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d610456-d6aa-4328-b320-cec443448d03 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:52.826345 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d610456-d6aa-4328-b320-cec443448d03 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:52.826619 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d610456-d6aa-4328-b320-cec443448d03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:52.839709 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d610456-d6aa-4328-b320-cec443448d03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:52.841226 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d610456-d6aa-4328-b320-cec443448d03 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:52.858084 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-4d610456-d6aa-4328-b320-cec443448d03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:29:52.858084 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:29:52.858084 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:29:52.858084 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:29:52.858084 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:29:52.858084 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:29:52.858084 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:29:52.858084 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:29:52.858084 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:29:52.858084 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:29:52.858084 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:29:52.858084 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:29:52.858084 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:29:52.858084 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:29:52.858084 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:29:52.859393 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:29:52.859393 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:29:52.859393 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:29:52.859393 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:29:52.859393 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:29:52.859393 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:29:52.859393 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:29:52.859393 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:29:52.859393 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:29:52.859393 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:29:52.859393 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:29:52.859393 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:29:52.859393 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:29:52.859393 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:29:52.859393 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:29:52.859393 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:29:52.859393 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:29:52.860523 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:29:52.860523 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:29:52.860523 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:29:52.860523 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:29:52.860523 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 437/877] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:29:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:29:52.865467 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe8720-5457-4a4c-97ee-e2989ccbe577 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:52.957936 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:52.972035 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe8720-5457-4a4c-97ee-e2989ccbe577 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:53.008735 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1063d8a-2541-4f13-aacb-14191150c74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:53.009364 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1063d8a-2541-4f13-aacb-14191150c74e None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:53.009691 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1063d8a-2541-4f13-aacb-14191150c74e None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:53.009962 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1063d8a-2541-4f13-aacb-14191150c74e None admin] PATH_INFO: `/v3/domains` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:53.010685 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1063d8a-2541-4f13-aacb-14191150c74e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:29:53.010987 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1063d8a-2541-4f13-aacb-14191150c74e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:53.012350 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1063d8a-2541-4f13-aacb-14191150c74e None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:53.024221 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 441/878] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:29:53.030089 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d610456-d6aa-4328-b320-cec443448d03 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:53.137171 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d610456-d6aa-4328-b320-cec443448d03 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:53.172555 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608c983-0ab1-481b-9b1f-b4173b6f4fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:53.173183 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608c983-0ab1-481b-9b1f-b4173b6f4fb2 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:53.173468 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608c983-0ab1-481b-9b1f-b4173b6f4fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:53.173773 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608c983-0ab1-481b-9b1f-b4173b6f4fb2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:53.180238 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f608c983-0ab1-481b-9b1f-b4173b6f4fb2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:53.181688 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f608c983-0ab1-481b-9b1f-b4173b6f4fb2 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:53.193359 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-f608c983-0ab1-481b-9b1f-b4173b6f4fb2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 12:29:53.193359 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:29:53.193359 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:29:53.193359 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:29:53.193359 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:29:53.193359 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:29:53.193359 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:29:53.193359 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:29:53.193359 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:29:53.193359 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:29:53.193359 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:29:53.193359 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:29:53.193359 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 12:29:53.193359 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 12:29:53.193359 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 12:29:53.194447 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 12:29:53.194447 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:29:53.194447 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:29:53.194447 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:29:53.194447 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:29:53.194447 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:29:53.194447 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:29:53.194447 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:29:53.194447 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:29:53.194447 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:29:53.194447 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:29:53.194447 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:29:53.194447 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:29:53.194447 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:29:53.194447 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:29:53.194447 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:29:53.194447 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:29:53.195405 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 12:29:53.195405 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 12:29:53.195405 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 12:29:53.195405 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 12:29:53.195405 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 12:29:53.195405 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 12:29:53.195405 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 12:29:53.195405 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:29:53.195405 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 438/879] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jul 27 12:29:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:29:53.200407 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1063d8a-2541-4f13-aacb-14191150c74e None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:53.303972 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1063d8a-2541-4f13-aacb-14191150c74e None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:53.343461 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446493df-a2f8-413a-9033-c5f47972f711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:53.344077 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446493df-a2f8-413a-9033-c5f47972f711 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:53.344358 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446493df-a2f8-413a-9033-c5f47972f711 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:53.344633 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446493df-a2f8-413a-9033-c5f47972f711 None admin] PATH_INFO: `/v3/projects` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:53.345378 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446493df-a2f8-413a-9033-c5f47972f711 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:29:53.345719 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446493df-a2f8-413a-9033-c5f47972f711 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:53.347145 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446493df-a2f8-413a-9033-c5f47972f711 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:53.358762 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 442/880] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jul 27 12:29:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:29:53.364978 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608c983-0ab1-481b-9b1f-b4173b6f4fb2 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:53.388213 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:53.465888 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608c983-0ab1-481b-9b1f-b4173b6f4fb2 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:53.498456 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981895d7-eee0-4d1a-a26e-fb6318f0b558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:53.499062 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981895d7-eee0-4d1a-a26e-fb6318f0b558 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:53.499855 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981895d7-eee0-4d1a-a26e-fb6318f0b558 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:53.500133 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981895d7-eee0-4d1a-a26e-fb6318f0b558 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:53.500912 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981895d7-eee0-4d1a-a26e-fb6318f0b558 None admin] RBAC: Adding query filter params (role.id=af00ed97066e4c72aeb6cd3d5b5d15c9, scope.project.id=e3316e9a169444ac827619608acc9fb7, user.id=6cc3f626dcb5495c9eed35a8e50092e9) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:29:53.501226 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981895d7-eee0-4d1a-a26e-fb6318f0b558 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:53.502675 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981895d7-eee0-4d1a-a26e-fb6318f0b558 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:53.507898 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 439/881] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jul 27 12:29:53 2022] GET /identity/v3/role_assignments?user.id=6cc3f626dcb5495c9eed35a8e50092e9&scope.project.id=e3316e9a169444ac827619608acc9fb7&role.id=af00ed97066e4c72aeb6cd3d5b5d15c9 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:29:55.696507 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9278cd9-ec39-4e2b-b9a2-983041675831 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:55.696906 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9278cd9-ec39-4e2b-b9a2-983041675831 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:55.697062 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9278cd9-ec39-4e2b-b9a2-983041675831 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:55.698466 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 443/882] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:29:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:29:55.703612 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86517e20-e493-4b46-820d-f1809e1b749d None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:55.703986 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86517e20-e493-4b46-820d-f1809e1b749d None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:55.704176 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86517e20-e493-4b46-820d-f1809e1b749d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:55.722365 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-86517e20-e493-4b46-820d-f1809e1b749d None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:29:55.723551 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-86517e20-e493-4b46-820d-f1809e1b749d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:29:55.787875 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 440/883] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:29:55 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 12:29:55.811553 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9278cd9-ec39-4e2b-b9a2-983041675831 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:55.822481 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:55.910807 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9278cd9-ec39-4e2b-b9a2-983041675831 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:55.944015 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216cfa0-4f35-4db9-9ebf-e9fbe564dd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:55.944583 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216cfa0-4f35-4db9-9ebf-e9fbe564dd2a None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:55.944867 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216cfa0-4f35-4db9-9ebf-e9fbe564dd2a None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:55.945145 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216cfa0-4f35-4db9-9ebf-e9fbe564dd2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:55.954943 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2216cfa0-4f35-4db9-9ebf-e9fbe564dd2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:29:55.959856 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-2216cfa0-4f35-4db9-9ebf-e9fbe564dd2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 12:29:55.959856 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:29:55.959856 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:29:55.959856 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:29:55.959856 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:29:55.959856 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:29:55.959856 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:29:55.959856 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:29:55.959856 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:29:55.959856 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:29:55.959856 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:29:55.959856 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:29:55.959856 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:29:55.959856 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:29:55.959856 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:29:55.959856 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:29:55.960945 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:29:55.960945 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:29:55.960945 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:29:55.960945 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:29:55.960945 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:29:55.960945 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:29:55.960945 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:29:55.960945 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:29:55.960945 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:29:55.960945 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:29:55.960945 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:29:55.960945 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:29:55.960945 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:29:55.960945 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:29:55.960945 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:29:55.960945 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:29:55.962001 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:29:55.962001 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:29:55.962001 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:29:55.962001 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:29:55.962001 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:29:55.962001 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:29:55.962001 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:29:55.962001 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:29:55.962001 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:29:55.962001 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:29:55.962001 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 12:29:55.962001 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:29:55.962001 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 444/884] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jul 27 12:29:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:29:55.966904 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86517e20-e493-4b46-820d-f1809e1b749d None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:55.981614 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:56.063936 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86517e20-e493-4b46-820d-f1809e1b749d None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:56.097188 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce975dea-ced7-4598-a54b-083517af7470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:56.097825 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce975dea-ced7-4598-a54b-083517af7470 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:56.098112 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce975dea-ced7-4598-a54b-083517af7470 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:56.098391 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce975dea-ced7-4598-a54b-083517af7470 None admin] PATH_INFO: `/v3/roles` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:56.099110 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce975dea-ced7-4598-a54b-083517af7470 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:29:56.099420 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce975dea-ced7-4598-a54b-083517af7470 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:56.100770 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce975dea-ced7-4598-a54b-083517af7470 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:56.109193 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 441/885] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:29:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:29:56.114725 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216cfa0-4f35-4db9-9ebf-e9fbe564dd2a None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:56.179993 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:56.212484 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216cfa0-4f35-4db9-9ebf-e9fbe564dd2a None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:56.245709 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a59837-fc4a-417e-a6c6-31f5c0910129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:56.246331 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a59837-fc4a-417e-a6c6-31f5c0910129 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:56.246612 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a59837-fc4a-417e-a6c6-31f5c0910129 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:56.246887 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a59837-fc4a-417e-a6c6-31f5c0910129 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:56.257184 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a59837-fc4a-417e-a6c6-31f5c0910129 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:56.258655 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a59837-fc4a-417e-a6c6-31f5c0910129 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:56.274989 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-24a59837-fc4a-417e-a6c6-31f5c0910129 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:29:56.274989 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:29:56.274989 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:29:56.274989 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:29:56.274989 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:29:56.274989 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:29:56.274989 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:29:56.274989 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:29:56.274989 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:29:56.274989 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:29:56.274989 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:29:56.274989 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:29:56.274989 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:29:56.274989 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:29:56.274989 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:29:56.276288 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:29:56.276288 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:29:56.276288 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:29:56.276288 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:29:56.276288 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:29:56.276288 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:29:56.276288 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:29:56.276288 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:29:56.276288 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:29:56.276288 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:29:56.276288 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:29:56.276288 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:29:56.276288 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:29:56.276288 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:29:56.276288 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:29:56.276288 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:29:56.276288 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:29:56.277291 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:29:56.277291 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:29:56.277291 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:29:56.277291 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:29:56.277291 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 445/886] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:29:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:29:56.283266 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce975dea-ced7-4598-a54b-083517af7470 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:56.380801 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:56.404178 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce975dea-ced7-4598-a54b-083517af7470 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:56.437790 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0cc60e-9b04-4a28-a63a-5fe55fd54da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:56.438399 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0cc60e-9b04-4a28-a63a-5fe55fd54da4 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:56.438684 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0cc60e-9b04-4a28-a63a-5fe55fd54da4 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:56.438964 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0cc60e-9b04-4a28-a63a-5fe55fd54da4 None admin] PATH_INFO: `/v3/domains` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:56.439654 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0cc60e-9b04-4a28-a63a-5fe55fd54da4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:29:56.439962 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0cc60e-9b04-4a28-a63a-5fe55fd54da4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:56.441332 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0cc60e-9b04-4a28-a63a-5fe55fd54da4 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:56.453218 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 442/887] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:29:56.458874 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a59837-fc4a-417e-a6c6-31f5c0910129 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:56.555705 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a59837-fc4a-417e-a6c6-31f5c0910129 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:56.574975 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:56.589866 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4da97-accb-46c3-b150-e20504a95f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:56.590494 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4da97-accb-46c3-b150-e20504a95f8d None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:56.590774 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4da97-accb-46c3-b150-e20504a95f8d None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:56.591045 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4da97-accb-46c3-b150-e20504a95f8d None admin] PATH_INFO: `/v3/users/placement` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:56.599023 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4da97-accb-46c3-b150-e20504a95f8d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:56.600452 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4da97-accb-46c3-b150-e20504a95f8d None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:56.611833 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-c7e4da97-accb-46c3-b150-e20504a95f8d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 12:29:56.611833 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:29:56.611833 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:29:56.611833 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:29:56.611833 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:29:56.611833 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:29:56.611833 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:29:56.611833 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:29:56.611833 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:29:56.611833 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:29:56.611833 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:29:56.611833 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:29:56.611833 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 12:29:56.611833 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 12:29:56.611833 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 12:29:56.611833 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 12:29:56.612981 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:29:56.612981 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:29:56.612981 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 12:29:56.612981 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:29:56.612981 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 12:29:56.612981 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:29:56.612981 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:29:56.612981 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:29:56.612981 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:29:56.612981 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:29:56.612981 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:29:56.612981 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:29:56.612981 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:29:56.612981 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:29:56.612981 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:29:56.612981 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:29:56.612981 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:29:56.612981 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:29:56.614201 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:29:56.614201 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:29:56.614201 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 12:29:56.614201 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 12:29:56.614201 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 12:29:56.614201 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 12:29:56.614201 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 12:29:56.614201 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 12:29:56.614201 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 12:29:56.614201 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:29:56.614201 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 446/888] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:29:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:29:56.619021 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0cc60e-9b04-4a28-a63a-5fe55fd54da4 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:56.718536 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0cc60e-9b04-4a28-a63a-5fe55fd54da4 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:56.752414 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fd5c4-2a57-4aa4-950f-7428a49b5842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:56.752962 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fd5c4-2a57-4aa4-950f-7428a49b5842 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:56.753249 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fd5c4-2a57-4aa4-950f-7428a49b5842 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:56.753527 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fd5c4-2a57-4aa4-950f-7428a49b5842 None admin] PATH_INFO: `/v3/users` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:56.754345 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91fd5c4-2a57-4aa4-950f-7428a49b5842 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:29:56.754659 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91fd5c4-2a57-4aa4-950f-7428a49b5842 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:56.756075 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91fd5c4-2a57-4aa4-950f-7428a49b5842 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:56.758610 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:56.773128 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 443/889] 10.222.0.55 () {56 vars in 1143 bytes} [Wed Jul 27 12:29:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:29:56.778874 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4da97-accb-46c3-b150-e20504a95f8d None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:56.875620 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4da97-accb-46c3-b150-e20504a95f8d None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:56.907924 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb37035-1874-4ed5-bc06-c1fe76d0cfe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:56.908535 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb37035-1874-4ed5-bc06-c1fe76d0cfe1 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:56.908813 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb37035-1874-4ed5-bc06-c1fe76d0cfe1 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:56.909086 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb37035-1874-4ed5-bc06-c1fe76d0cfe1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:56.919102 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb37035-1874-4ed5-bc06-c1fe76d0cfe1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:56.920527 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb37035-1874-4ed5-bc06-c1fe76d0cfe1 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:56.934087 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-5eb37035-1874-4ed5-bc06-c1fe76d0cfe1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:29:56.934087 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:29:56.934087 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:29:56.934087 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:29:56.934087 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:29:56.934087 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:29:56.934087 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:29:56.934087 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:29:56.934087 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:29:56.934087 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:29:56.934087 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:29:56.934087 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:29:56.934087 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:29:56.934087 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:29:56.934087 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:29:56.935126 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:29:56.935126 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:29:56.935126 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:29:56.935126 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:29:56.935126 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:29:56.935126 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:29:56.935126 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:29:56.935126 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:29:56.935126 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:29:56.935126 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:29:56.935126 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:29:56.935126 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:29:56.935126 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:29:56.935126 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:29:56.935126 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:29:56.935126 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:29:56.935126 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:29:56.936244 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:29:56.936244 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:29:56.936244 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:29:56.936244 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:29:56.936244 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 447/890] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:29:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:29:56.940860 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fd5c4-2a57-4aa4-950f-7428a49b5842 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:57.036686 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fd5c4-2a57-4aa4-950f-7428a49b5842 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:57.069119 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26fc5c7-b830-43ca-84ab-1cac20e9d1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:57.069750 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fc5c7-b830-43ca-84ab-1cac20e9d1e4 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:57.070038 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fc5c7-b830-43ca-84ab-1cac20e9d1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:57.070316 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fc5c7-b830-43ca-84ab-1cac20e9d1e4 None admin] PATH_INFO: `/v3/domains` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:57.071000 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26fc5c7-b830-43ca-84ab-1cac20e9d1e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:29:57.071306 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26fc5c7-b830-43ca-84ab-1cac20e9d1e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:57.072649 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26fc5c7-b830-43ca-84ab-1cac20e9d1e4 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:57.084056 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 444/891] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:29:57.089766 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb37035-1874-4ed5-bc06-c1fe76d0cfe1 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:57.119858 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:57.185041 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb37035-1874-4ed5-bc06-c1fe76d0cfe1 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:57.217214 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9dcde-3293-41d4-8cc3-aa6f6621caf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:57.217869 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9dcde-3293-41d4-8cc3-aa6f6621caf4 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:57.218695 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9dcde-3293-41d4-8cc3-aa6f6621caf4 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:57.218965 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9dcde-3293-41d4-8cc3-aa6f6621caf4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:57.225250 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c9dcde-3293-41d4-8cc3-aa6f6621caf4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:57.226702 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c9dcde-3293-41d4-8cc3-aa6f6621caf4 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:57.238277 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-a7c9dcde-3293-41d4-8cc3-aa6f6621caf4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 12:29:57.238277 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:29:57.238277 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:29:57.238277 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:29:57.238277 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:29:57.238277 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:29:57.238277 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:29:57.238277 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:29:57.238277 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:29:57.238277 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:29:57.238277 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:29:57.238277 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:29:57.238277 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 12:29:57.238277 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 12:29:57.238277 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 12:29:57.239324 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 12:29:57.239324 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:29:57.239324 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:29:57.239324 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:29:57.239324 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:29:57.239324 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:29:57.239324 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:29:57.239324 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:29:57.239324 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:29:57.239324 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:29:57.239324 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:29:57.239324 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:29:57.239324 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:29:57.239324 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:29:57.239324 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:29:57.239324 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:29:57.239324 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:29:57.240476 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 12:29:57.240476 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 12:29:57.240476 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 12:29:57.240476 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 12:29:57.240476 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 12:29:57.240476 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 12:29:57.240476 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 12:29:57.240476 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:29:57.240476 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 448/892] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jul 27 12:29:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:29:57.245369 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26fc5c7-b830-43ca-84ab-1cac20e9d1e4 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:57.308106 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:57.353169 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26fc5c7-b830-43ca-84ab-1cac20e9d1e4 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:57.386694 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafedaf-870d-45d3-a1fc-290321bf863c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:57.387307 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafedaf-870d-45d3-a1fc-290321bf863c None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:57.387593 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafedaf-870d-45d3-a1fc-290321bf863c None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:57.387869 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafedaf-870d-45d3-a1fc-290321bf863c None admin] PATH_INFO: `/v3/projects` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:57.388616 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafedaf-870d-45d3-a1fc-290321bf863c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:29:57.388925 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafedaf-870d-45d3-a1fc-290321bf863c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:57.390390 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafedaf-870d-45d3-a1fc-290321bf863c None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:57.402199 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 445/893] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jul 27 12:29:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:29:57.408202 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9dcde-3293-41d4-8cc3-aa6f6621caf4 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:57.497075 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:57.506375 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9dcde-3293-41d4-8cc3-aa6f6621caf4 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:57.538274 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a410c0ac-c4cf-4e2b-8490-cdb37dd6adc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:57.538935 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410c0ac-c4cf-4e2b-8490-cdb37dd6adc4 None admin] REQUEST_METHOD: `PUT` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:57.539222 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410c0ac-c4cf-4e2b-8490-cdb37dd6adc4 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:57.539502 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410c0ac-c4cf-4e2b-8490-cdb37dd6adc4 None admin] PATH_INFO: `/v3/projects/e3316e9a169444ac827619608acc9fb7/users/6cc3f626dcb5495c9eed35a8e50092e9/roles/af00ed97066e4c72aeb6cd3d5b5d15c9` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:57.541435 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a410c0ac-c4cf-4e2b-8490-cdb37dd6adc4 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3316e9a169444ac827619608acc9fb7, user_id=6cc3f626dcb5495c9eed35a8e50092e9, role_id=af00ed97066e4c72aeb6cd3d5b5d15c9)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:29:57.542907 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a410c0ac-c4cf-4e2b-8490-cdb37dd6adc4 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:29:57.556170 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 449/894] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Jul 27 12:29:57 2022] PUT /identity/v3/projects/e3316e9a169444ac827619608acc9fb7/users/6cc3f626dcb5495c9eed35a8e50092e9/roles/af00ed97066e4c72aeb6cd3d5b5d15c9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 12:29:59.726886 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4924e5-5698-4808-8c30-ee11028b8f54 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:59.727315 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4924e5-5698-4808-8c30-ee11028b8f54 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:59.727428 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4924e5-5698-4808-8c30-ee11028b8f54 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:59.728783 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 446/895] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:29:59.734301 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d778f-a56f-44a4-ba44-b099f1efef2c None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:59.734703 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d778f-a56f-44a4-ba44-b099f1efef2c None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:59.734863 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d778f-a56f-44a4-ba44-b099f1efef2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:59.753361 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-ef5d778f-a56f-44a4-ba44-b099f1efef2c None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:29:59.754585 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-ef5d778f-a56f-44a4-ba44-b099f1efef2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:29:59.821849 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 450/896] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:29:59 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 12:29:59.845164 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4924e5-5698-4808-8c30-ee11028b8f54 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:29:59.943298 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4924e5-5698-4808-8c30-ee11028b8f54 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:29:59.956434 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:29:59.976260 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd36c1f-dfde-46b4-b289-e04c4cc6e477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:29:59.976879 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd36c1f-dfde-46b4-b289-e04c4cc6e477 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:29:59.977163 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd36c1f-dfde-46b4-b289-e04c4cc6e477 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:29:59.977437 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd36c1f-dfde-46b4-b289-e04c4cc6e477 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:29:59.987711 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd36c1f-dfde-46b4-b289-e04c4cc6e477 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 12:29:59.992825 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-3bd36c1f-dfde-46b4-b289-e04c4cc6e477 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 12:29:59.992825 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:29:59.992825 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:29:59.992825 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:29:59.992825 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:29:59.992825 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:29:59.992825 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:29:59.992825 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:29:59.992825 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:29:59.992825 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:29:59.992825 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:29:59.992825 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:29:59.992825 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 12:29:59.992825 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 12:29:59.992825 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 12:29:59.992825 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 12:29:59.993978 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 12:29:59.993978 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 12:29:59.993978 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 12:29:59.993978 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 12:29:59.993978 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:29:59.993978 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:29:59.993978 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:29:59.993978 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:29:59.993978 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:29:59.993978 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:29:59.993978 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:29:59.993978 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:29:59.993978 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:29:59.993978 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:29:59.993978 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:29:59.993978 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:29:59.995267 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:29:59.995267 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:29:59.995267 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:29:59.995267 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:29:59.995267 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 12:29:59.995267 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 12:29:59.995267 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 12:29:59.995267 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 12:29:59.995267 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 12:29:59.995267 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 12:29:59.995267 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 12:29:59.995267 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:29:59.995267 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 447/897] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Jul 27 12:29:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:29:59.999835 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d778f-a56f-44a4-ba44-b099f1efef2c None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:30:00.077244 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:30:00.105893 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d778f-a56f-44a4-ba44-b099f1efef2c None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:30:00.144321 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a3c7d-b186-4838-bc60-f692af715cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:30:00.144948 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a3c7d-b186-4838-bc60-f692af715cf8 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:30:00.145232 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a3c7d-b186-4838-bc60-f692af715cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:30:00.145512 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a3c7d-b186-4838-bc60-f692af715cf8 None admin] PATH_INFO: `/v3/roles` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:30:00.146286 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a3c7d-b186-4838-bc60-f692af715cf8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:30:00.146594 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a3c7d-b186-4838-bc60-f692af715cf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:30:00.147974 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a3c7d-b186-4838-bc60-f692af715cf8 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:30:00.156752 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 451/898] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Jul 27 12:29:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:30:00.162495 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd36c1f-dfde-46b4-b289-e04c4cc6e477 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:30:00.266778 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd36c1f-dfde-46b4-b289-e04c4cc6e477 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:30:00.307452 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae6c22-65de-4f88-a773-781c19c87add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:30:00.308200 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae6c22-65de-4f88-a773-781c19c87add None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:30:00.308502 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae6c22-65de-4f88-a773-781c19c87add None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:30:00.308828 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae6c22-65de-4f88-a773-781c19c87add None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:30:00.321200 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae6c22-65de-4f88-a773-781c19c87add None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:30:00.322937 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae6c22-65de-4f88-a773-781c19c87add None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:30:00.340482 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-6dae6c22-65de-4f88-a773-781c19c87add None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:30:00.340482 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:30:00.340482 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:30:00.340482 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:30:00.340482 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:30:00.340482 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:30:00.340482 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:30:00.340482 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:30:00.340482 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:30:00.340482 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:30:00.340482 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:30:00.340482 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:30:00.340482 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:30:00.340482 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:30:00.340482 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:30:00.341563 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:30:00.341563 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:30:00.341563 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:30:00.341563 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:30:00.341563 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:30:00.341563 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:30:00.341563 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:30:00.341563 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:30:00.341563 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:30:00.341563 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:30:00.341563 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:30:00.341563 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:30:00.341563 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:30:00.341563 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:30:00.341563 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:30:00.341563 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:30:00.341563 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:30:00.342581 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:30:00.342581 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:30:00.342581 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:30:00.342581 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:30:00.342581 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 448/899] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:30:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:30:00.348036 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a3c7d-b186-4838-bc60-f692af715cf8 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:30:00.451693 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a3c7d-b186-4838-bc60-f692af715cf8 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:30:00.483959 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d13980-feaf-4ece-be4c-649887259934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:30:00.484566 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d13980-feaf-4ece-be4c-649887259934 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:30:00.484843 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d13980-feaf-4ece-be4c-649887259934 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:30:00.485109 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d13980-feaf-4ece-be4c-649887259934 None admin] PATH_INFO: `/v3/domains` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:30:00.485813 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d13980-feaf-4ece-be4c-649887259934 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:30:00.486112 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d13980-feaf-4ece-be4c-649887259934 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:30:00.487492 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d13980-feaf-4ece-be4c-649887259934 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:30:00.498916 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 452/900] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:30:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:30:00.505199 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae6c22-65de-4f88-a773-781c19c87add None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:30:00.531775 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:30:00.601066 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae6c22-65de-4f88-a773-781c19c87add None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:30:00.633921 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e58118-7c18-4a82-9b4e-3ae7969e2425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:30:00.634545 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e58118-7c18-4a82-9b4e-3ae7969e2425 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:30:00.634828 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e58118-7c18-4a82-9b4e-3ae7969e2425 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:30:00.635100 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e58118-7c18-4a82-9b4e-3ae7969e2425 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:30:00.642292 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e58118-7c18-4a82-9b4e-3ae7969e2425 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:30:00.643703 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e58118-7c18-4a82-9b4e-3ae7969e2425 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:30:00.654538 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-f3e58118-7c18-4a82-9b4e-3ae7969e2425 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 12:30:00.654538 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:30:00.654538 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:30:00.654538 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:30:00.654538 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:30:00.654538 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:30:00.654538 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:30:00.654538 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:30:00.654538 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:30:00.654538 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:30:00.654538 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:30:00.654538 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:30:00.654538 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 12:30:00.654538 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 12:30:00.654538 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 12:30:00.654538 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 12:30:00.655672 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:30:00.655672 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:30:00.655672 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 12:30:00.655672 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:30:00.655672 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 12:30:00.655672 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 12:30:00.655672 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:30:00.655672 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:30:00.655672 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:30:00.655672 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:30:00.655672 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:30:00.655672 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:30:00.655672 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:30:00.655672 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:30:00.655672 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:30:00.655672 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:30:00.655672 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:30:00.655672 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:30:00.656627 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:30:00.656627 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:30:00.656627 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 12:30:00.656627 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 12:30:00.656627 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 12:30:00.656627 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 12:30:00.656627 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 12:30:00.656627 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 12:30:00.656627 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 12:30:00.656627 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:30:00.656627 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 449/901] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:30:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:30:00.661663 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d13980-feaf-4ece-be4c-649887259934 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:30:00.668744 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:30:00.770463 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d13980-feaf-4ece-be4c-649887259934 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:30:00.803942 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6343eef2-263f-49e1-9f86-eea10be9ae93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:30:00.804499 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343eef2-263f-49e1-9f86-eea10be9ae93 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:30:00.804782 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343eef2-263f-49e1-9f86-eea10be9ae93 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:30:00.805061 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343eef2-263f-49e1-9f86-eea10be9ae93 None admin] PATH_INFO: `/v3/users` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:30:00.805890 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343eef2-263f-49e1-9f86-eea10be9ae93 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:30:00.806202 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343eef2-263f-49e1-9f86-eea10be9ae93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:30:00.807623 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343eef2-263f-49e1-9f86-eea10be9ae93 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:30:00.828782 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 453/902] 10.222.0.55 () {56 vars in 1143 bytes} [Wed Jul 27 12:30:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:30:00.835893 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e58118-7c18-4a82-9b4e-3ae7969e2425 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:30:00.921000 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:30:00.936078 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e58118-7c18-4a82-9b4e-3ae7969e2425 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:30:00.969848 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04a79d-48b6-4476-b618-4ddcae6a6944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:30:00.970456 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04a79d-48b6-4476-b618-4ddcae6a6944 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:30:00.970737 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04a79d-48b6-4476-b618-4ddcae6a6944 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:30:00.971008 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04a79d-48b6-4476-b618-4ddcae6a6944 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:30:01.037338 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f04a79d-48b6-4476-b618-4ddcae6a6944 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:30:01.038953 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f04a79d-48b6-4476-b618-4ddcae6a6944 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:30:01.120283 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:30:01.136760 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 450/903] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Jul 27 12:30:00 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 12:30:01.142850 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6343eef2-263f-49e1-9f86-eea10be9ae93 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:30:01.213043 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:30:01.255086 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6343eef2-263f-49e1-9f86-eea10be9ae93 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:30:01.289810 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa1150-cdd2-4c5a-b11b-edecc013a378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:30:01.290487 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa1150-cdd2-4c5a-b11b-edecc013a378 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:30:01.290749 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa1150-cdd2-4c5a-b11b-edecc013a378 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:30:01.291035 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa1150-cdd2-4c5a-b11b-edecc013a378 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:30:01.302644 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fa1150-cdd2-4c5a-b11b-edecc013a378 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:30:01.304095 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fa1150-cdd2-4c5a-b11b-edecc013a378 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:30:01.321002 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-f6fa1150-cdd2-4c5a-b11b-edecc013a378 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:30:01.321002 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:30:01.321002 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:30:01.321002 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:30:01.321002 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:30:01.321002 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:30:01.321002 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:30:01.321002 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:30:01.321002 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:30:01.321002 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:30:01.321002 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:30:01.321002 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:30:01.321002 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 12:30:01.321002 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 12:30:01.321002 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 12:30:01.322182 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 12:30:01.322182 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:30:01.322182 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:30:01.322182 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:30:01.322182 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:30:01.322182 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:30:01.322182 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:30:01.322182 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:30:01.322182 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:30:01.322182 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:30:01.322182 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:30:01.322182 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:30:01.322182 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:30:01.322182 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:30:01.322182 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:30:01.322182 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:30:01.322182 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:30:01.323272 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 12:30:01.323272 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 12:30:01.323272 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 12:30:01.323272 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:30:01.323272 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 454/904] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:30:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:30:01.328369 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04a79d-48b6-4476-b618-4ddcae6a6944 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:30:01.428935 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04a79d-48b6-4476-b618-4ddcae6a6944 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:30:01.462756 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319acef1-8110-49aa-a6db-e39bbceb1a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:30:01.463368 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319acef1-8110-49aa-a6db-e39bbceb1a6f None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:30:01.463653 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319acef1-8110-49aa-a6db-e39bbceb1a6f None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:30:01.463928 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319acef1-8110-49aa-a6db-e39bbceb1a6f None admin] PATH_INFO: `/v3/domains` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:30:01.464620 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319acef1-8110-49aa-a6db-e39bbceb1a6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:30:01.464922 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319acef1-8110-49aa-a6db-e39bbceb1a6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:30:01.466286 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319acef1-8110-49aa-a6db-e39bbceb1a6f None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:30:01.477822 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 451/905] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Jul 27 12:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:30:01.485182 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa1150-cdd2-4c5a-b11b-edecc013a378 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:30:01.591265 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa1150-cdd2-4c5a-b11b-edecc013a378 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:30:01.604292 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:30:01.623522 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca03e0-36c9-4655-905e-ca42ce74a3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:30:01.624671 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca03e0-36c9-4655-905e-ca42ce74a3d4 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:30:01.624948 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca03e0-36c9-4655-905e-ca42ce74a3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:30:01.625221 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca03e0-36c9-4655-905e-ca42ce74a3d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:30:01.631571 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca03e0-36c9-4655-905e-ca42ce74a3d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:30:01.632998 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca03e0-36c9-4655-905e-ca42ce74a3d4 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:30:01.645790 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application [None req-06ca03e0-36c9-4655-905e-ca42ce74a3d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 12:30:01.645790 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:30:01.645790 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:30:01.645790 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:30:01.645790 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:30:01.645790 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:30:01.645790 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:30:01.645790 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:30:01.645790 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:30:01.645790 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:30:01.645790 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:30:01.645790 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:30:01.645790 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 12:30:01.645790 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 12:30:01.645790 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 12:30:01.646801 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 12:30:01.646801 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:30:01.646801 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:30:01.646801 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:30:01.646801 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:30:01.646801 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:30:01.646801 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:30:01.646801 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:30:01.646801 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application with Lock( Jul 27 12:30:01.646801 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:30:01.646801 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:30:01.646801 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:30:01.646801 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:30:01.646801 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:30:01.646801 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:30:01.646801 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:30:01.646801 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:30:01.647749 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 12:30:01.647749 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 12:30:01.647749 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 12:30:01.647749 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 12:30:01.647749 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 12:30:01.647749 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 12:30:01.647749 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 12:30:01.647749 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: ERROR keystone.server.flask.application Jul 27 12:30:01.647749 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 455/906] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Jul 27 12:30:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:30:01.653101 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319acef1-8110-49aa-a6db-e39bbceb1a6f None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:30:01.699307 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:30:01.750176 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319acef1-8110-49aa-a6db-e39bbceb1a6f None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:30:01.782077 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a187cd-9b25-40a9-989e-1f8597d73d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:30:01.782674 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a187cd-9b25-40a9-989e-1f8597d73d7d None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:30:01.782954 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a187cd-9b25-40a9-989e-1f8597d73d7d None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:30:01.783226 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a187cd-9b25-40a9-989e-1f8597d73d7d None admin] PATH_INFO: `/v3/projects` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:30:01.783959 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a187cd-9b25-40a9-989e-1f8597d73d7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:30:01.784263 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a187cd-9b25-40a9-989e-1f8597d73d7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:30:01.785690 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a187cd-9b25-40a9-989e-1f8597d73d7d None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:30:01.797104 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 452/907] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Jul 27 12:30:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:30:01.803352 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca03e0-36c9-4655-905e-ca42ce74a3d4 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:30:01.901423 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca03e0-36c9-4655-905e-ca42ce74a3d4 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:30:01.933719 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07140d9d-e7cb-4fc2-a53f-053c361fcb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:30:01.934324 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07140d9d-e7cb-4fc2-a53f-053c361fcb97 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:30:01.934602 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07140d9d-e7cb-4fc2-a53f-053c361fcb97 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:30:01.934876 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07140d9d-e7cb-4fc2-a53f-053c361fcb97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:30:01.935649 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07140d9d-e7cb-4fc2-a53f-053c361fcb97 None admin] RBAC: Adding query filter params (role.id=af00ed97066e4c72aeb6cd3d5b5d15c9, scope.project.id=e3316e9a169444ac827619608acc9fb7, user.id=6cc3f626dcb5495c9eed35a8e50092e9) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:30:01.935954 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07140d9d-e7cb-4fc2-a53f-053c361fcb97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:30:01.937416 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07140d9d-e7cb-4fc2-a53f-053c361fcb97 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:30:01.943585 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 456/908] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Jul 27 12:30:01 2022] GET /identity/v3/role_assignments?user.id=6cc3f626dcb5495c9eed35a8e50092e9&scope.project.id=e3316e9a169444ac827619608acc9fb7&role.id=af00ed97066e4c72aeb6cd3d5b5d15c9 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:30:04.162347 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b8605-ee34-4a5e-9dc4-a9e860552b18 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:30:04.162905 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b8605-ee34-4a5e-9dc4-a9e860552b18 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:30:04.162905 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b8605-ee34-4a5e-9dc4-a9e860552b18 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:30:04.164219 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 453/909] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:30:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:30:04.169359 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f75b4-b5e7-494d-b8e7-3705ad9ebacf None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:30:04.169779 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f75b4-b5e7-494d-b8e7-3705ad9ebacf None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:30:04.169942 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f75b4-b5e7-494d-b8e7-3705ad9ebacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:30:04.187390 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-040f75b4-b5e7-494d-b8e7-3705ad9ebacf None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:30:04.188577 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-040f75b4-b5e7-494d-b8e7-3705ad9ebacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:30:04.216489 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:30:04.253735 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 457/910] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:30:04 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 12:30:04.277385 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b8605-ee34-4a5e-9dc4-a9e860552b18 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:30:04.388115 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b8605-ee34-4a5e-9dc4-a9e860552b18 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:30:04.395702 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:30:04.421941 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b48c8-f67b-49d7-a123-b29f265294b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:30:04.422514 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b48c8-f67b-49d7-a123-b29f265294b8 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:30:04.422798 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b48c8-f67b-49d7-a123-b29f265294b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:30:04.423073 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b48c8-f67b-49d7-a123-b29f265294b8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:30:04.423696 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b48c8-f67b-49d7-a123-b29f265294b8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:30:04.425051 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b48c8-f67b-49d7-a123-b29f265294b8 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:30:04.433764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-8e1b48c8-f67b-49d7-a123-b29f265294b8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 12:30:04.433764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:30:04.433764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 12:30:04.433764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 12:30:04.433764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 12:30:04.433764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 12:30:04.433764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 12:30:04.433764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 12:30:04.433764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 12:30:04.433764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:30:04.433764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 12:30:04.433764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:30:04.433764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:30:04.433764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:30:04.433764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:30:04.433764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:30:04.433764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:30:04.434961 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:30:04.434961 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:30:04.434961 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:30:04.434961 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:30:04.434961 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:30:04.434961 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:30:04.434961 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 12:30:04.434961 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 12:30:04.434961 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 12:30:04.434961 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 12:30:04.434961 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:30:04.434961 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:30:04.434961 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:30:04.434961 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:30:04.434961 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:30:04.434961 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:30:04.436029 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:30:04.436029 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:30:04.436029 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:30:04.436029 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:30:04.436029 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:30:04.436029 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:30:04.436029 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:30:04.436029 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:30:04.436029 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:30:04.436029 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:30:04.436029 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 12:30:04.436029 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 12:30:04.436029 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 12:30:04.436029 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:30:04.436029 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 454/911] 10.222.0.55 () {56 vars in 1117 bytes} [Wed Jul 27 12:30:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:30:04.441652 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f75b4-b5e7-494d-b8e7-3705ad9ebacf None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:30:04.544629 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f75b4-b5e7-494d-b8e7-3705ad9ebacf None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:30:04.577635 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee470228-a2b5-4123-83f3-5d5e3d7e0a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:30:04.578756 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee470228-a2b5-4123-83f3-5d5e3d7e0a80 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:30:04.579040 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee470228-a2b5-4123-83f3-5d5e3d7e0a80 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:30:04.579317 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee470228-a2b5-4123-83f3-5d5e3d7e0a80 None admin] PATH_INFO: `/v3/services` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:30:04.579993 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee470228-a2b5-4123-83f3-5d5e3d7e0a80 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:30:04.580301 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee470228-a2b5-4123-83f3-5d5e3d7e0a80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:30:04.581690 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee470228-a2b5-4123-83f3-5d5e3d7e0a80 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:30:04.586350 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 458/912] 10.222.0.55 () {56 vars in 1116 bytes} [Wed Jul 27 12:30:04 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:30:04.592194 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b48c8-f67b-49d7-a123-b29f265294b8 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:30:04.687805 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b48c8-f67b-49d7-a123-b29f265294b8 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:30:04.721358 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9812e37-5a12-472b-8cb4-989624084d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:30:04.722027 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9812e37-5a12-472b-8cb4-989624084d35 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:30:04.722308 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9812e37-5a12-472b-8cb4-989624084d35 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:30:04.722582 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9812e37-5a12-472b-8cb4-989624084d35 None admin] PATH_INFO: `/v3/services` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:30:04.723249 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9812e37-5a12-472b-8cb4-989624084d35 None admin] RBAC: Adding query filter params (type=placement) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:30:04.723550 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9812e37-5a12-472b-8cb4-989624084d35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:30:04.724902 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9812e37-5a12-472b-8cb4-989624084d35 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:30:04.729161 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 455/913] 10.222.0.55 () {56 vars in 1116 bytes} [Wed Jul 27 12:30:04 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:30:06.923811 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248d664-d4ff-46ac-b080-73f336de06e3 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:30:06.924347 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248d664-d4ff-46ac-b080-73f336de06e3 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:30:06.924444 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248d664-d4ff-46ac-b080-73f336de06e3 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:30:06.925762 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 459/914] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:30:06.930767 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d070991-3af6-4af5-b12c-37ad10529c05 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:30:06.931200 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d070991-3af6-4af5-b12c-37ad10529c05 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:30:06.931322 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d070991-3af6-4af5-b12c-37ad10529c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:30:06.949546 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-7d070991-3af6-4af5-b12c-37ad10529c05 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:30:06.950704 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-7d070991-3af6-4af5-b12c-37ad10529c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:30:06.977988 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:30:07.018163 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 456/915] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:30:06 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 12:30:07.041978 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248d664-d4ff-46ac-b080-73f336de06e3 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:30:07.073538 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:30:07.143164 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248d664-d4ff-46ac-b080-73f336de06e3 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:30:07.176016 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a3cfc-7d58-4ce9-bbd4-b52c25188181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:30:07.176632 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a3cfc-7d58-4ce9-bbd4-b52c25188181 None admin] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:30:07.176918 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a3cfc-7d58-4ce9-bbd4-b52c25188181 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:30:07.177197 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a3cfc-7d58-4ce9-bbd4-b52c25188181 None admin] PATH_INFO: `/v3/services` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:30:07.177934 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a3cfc-7d58-4ce9-bbd4-b52c25188181 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:30:07.179292 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a3cfc-7d58-4ce9-bbd4-b52c25188181 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:30:07.193454 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 460/916] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Jul 27 12:30:07 2022] POST /identity/v3/services => generated 246 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 12:30:09.448244 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b42be-13d4-453a-a90a-2f67161a040d None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:30:09.448765 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b42be-13d4-453a-a90a-2f67161a040d None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:30:09.448850 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b42be-13d4-453a-a90a-2f67161a040d None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:30:09.450208 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 457/917] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:30:09.455698 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f2907-b4cb-449b-b8ee-3f1198a2ae29 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:30:09.456111 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f2907-b4cb-449b-b8ee-3f1198a2ae29 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:30:09.456241 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f2907-b4cb-449b-b8ee-3f1198a2ae29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:30:09.475557 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-cd0f2907-b4cb-449b-b8ee-3f1198a2ae29 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:30:09.476744 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-cd0f2907-b4cb-449b-b8ee-3f1198a2ae29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:30:09.548175 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 461/918] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:30:09 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 12:30:09.571172 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b42be-13d4-453a-a90a-2f67161a040d None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:30:09.671327 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b42be-13d4-453a-a90a-2f67161a040d None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:30:09.705209 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21b095-cb5f-4515-93fc-f4d78e235099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:30:09.705814 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21b095-cb5f-4515-93fc-f4d78e235099 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:30:09.706101 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21b095-cb5f-4515-93fc-f4d78e235099 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:30:09.706375 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21b095-cb5f-4515-93fc-f4d78e235099 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:30:09.706999 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21b095-cb5f-4515-93fc-f4d78e235099 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:30:09.708357 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21b095-cb5f-4515-93fc-f4d78e235099 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:30:09.717231 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-4f21b095-cb5f-4515-93fc-f4d78e235099 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 12:30:09.717231 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:30:09.717231 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 12:30:09.717231 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 12:30:09.717231 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 12:30:09.717231 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 12:30:09.717231 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 12:30:09.717231 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 12:30:09.717231 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 12:30:09.717231 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:30:09.717231 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 12:30:09.717231 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:30:09.717231 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:30:09.717231 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:30:09.717231 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:30:09.717231 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:30:09.717231 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:30:09.719009 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:30:09.719009 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:30:09.719009 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:30:09.719009 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:30:09.719009 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:30:09.719009 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:30:09.719009 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 12:30:09.719009 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 12:30:09.719009 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 12:30:09.719009 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 12:30:09.719009 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:30:09.719009 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:30:09.719009 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:30:09.719009 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:30:09.719009 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:30:09.719009 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:30:09.719937 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:30:09.719937 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:30:09.719937 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:30:09.719937 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:30:09.719937 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:30:09.719937 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:30:09.719937 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:30:09.719937 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:30:09.719937 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:30:09.719937 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:30:09.719937 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 12:30:09.719937 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 12:30:09.719937 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 12:30:09.719937 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:30:09.719937 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 458/919] 10.222.0.55 () {56 vars in 1117 bytes} [Wed Jul 27 12:30:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:30:09.725487 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f2907-b4cb-449b-b8ee-3f1198a2ae29 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:30:09.743854 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:30:09.830384 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f2907-b4cb-449b-b8ee-3f1198a2ae29 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:30:09.863495 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf8e8e-3914-43f6-accb-99271b063875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:30:09.864110 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf8e8e-3914-43f6-accb-99271b063875 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:30:09.864393 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf8e8e-3914-43f6-accb-99271b063875 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:30:09.864674 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf8e8e-3914-43f6-accb-99271b063875 None admin] PATH_INFO: `/v3/services` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:30:09.865351 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf8e8e-3914-43f6-accb-99271b063875 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:30:09.865679 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf8e8e-3914-43f6-accb-99271b063875 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:30:09.867053 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf8e8e-3914-43f6-accb-99271b063875 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:30:09.872231 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 462/920] 10.222.0.55 () {56 vars in 1116 bytes} [Wed Jul 27 12:30:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:30:09.878962 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21b095-cb5f-4515-93fc-f4d78e235099 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:30:09.912435 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:30:09.993443 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21b095-cb5f-4515-93fc-f4d78e235099 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:30:10.026402 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f437a-455c-42a0-b28a-8b90b15072ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:30:10.027003 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f437a-455c-42a0-b28a-8b90b15072ec None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:30:10.027284 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f437a-455c-42a0-b28a-8b90b15072ec None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:30:10.027555 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f437a-455c-42a0-b28a-8b90b15072ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:30:10.028297 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f437a-455c-42a0-b28a-8b90b15072ec None admin] RBAC: Adding query filter params (interface=public, service_id=9135661071e94ffb8cf2129a51687a4e, region_id=RegionOne) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:30:10.028606 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f437a-455c-42a0-b28a-8b90b15072ec None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:30:10.030015 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f437a-455c-42a0-b28a-8b90b15072ec None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:30:10.036460 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 459/921] 10.222.0.55 () {56 vars in 1251 bytes} [Wed Jul 27 12:30:09 2022] GET /identity/v3/endpoints?service_id=9135661071e94ffb8cf2129a51687a4e&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:30:10.042223 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf8e8e-3914-43f6-accb-99271b063875 None admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:30:10.120464 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:30:10.138191 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf8e8e-3914-43f6-accb-99271b063875 None admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:30:10.169937 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda1ba3-e28d-437a-9a7a-387d8bd4f776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:30:10.170541 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda1ba3-e28d-437a-9a7a-387d8bd4f776 None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:30:10.171341 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda1ba3-e28d-437a-9a7a-387d8bd4f776 None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:30:10.171613 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda1ba3-e28d-437a-9a7a-387d8bd4f776 None admin] PATH_INFO: `/v3/services` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:30:10.172248 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda1ba3-e28d-437a-9a7a-387d8bd4f776 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:30:10.173617 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda1ba3-e28d-437a-9a7a-387d8bd4f776 None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:30:10.179867 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 463/922] 10.222.0.55 () {56 vars in 1087 bytes} [Wed Jul 27 12:30:10 2022] GET /identity/v3/services => generated 1962 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 12:30:12.415916 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad537a06-9a8b-4446-b73e-907843e75ef6 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:30:12.416438 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad537a06-9a8b-4446-b73e-907843e75ef6 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:30:12.416531 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad537a06-9a8b-4446-b73e-907843e75ef6 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:30:12.417862 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 460/923] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:30:12.423591 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d301cd-9697-458a-b64f-71bbcd1e4338 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:30:12.424003 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d301cd-9697-458a-b64f-71bbcd1e4338 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:30:12.424149 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d301cd-9697-458a-b64f-71bbcd1e4338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:30:12.442406 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-80d301cd-9697-458a-b64f-71bbcd1e4338 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:30:12.443592 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-80d301cd-9697-458a-b64f-71bbcd1e4338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:30:12.509005 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 464/924] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:30:12 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 12:30:12.533746 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad537a06-9a8b-4446-b73e-907843e75ef6 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:30:12.625778 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:30:12.635221 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad537a06-9a8b-4446-b73e-907843e75ef6 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:30:12.667360 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cfed99-d855-49bb-9c3f-2684400c8dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:30:12.667923 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cfed99-d855-49bb-9c3f-2684400c8dc3 None admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:30:12.668203 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cfed99-d855-49bb-9c3f-2684400c8dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:30:12.668475 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cfed99-d855-49bb-9c3f-2684400c8dc3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:30:12.669092 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cfed99-d855-49bb-9c3f-2684400c8dc3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:30:12.670462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cfed99-d855-49bb-9c3f-2684400c8dc3 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:30:12.679710 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application [None req-65cfed99-d855-49bb-9c3f-2684400c8dc3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 12:30:12.679710 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:30:12.679710 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 12:30:12.679710 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 12:30:12.679710 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 12:30:12.679710 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 12:30:12.679710 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 12:30:12.679710 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 12:30:12.679710 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 12:30:12.679710 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:30:12.679710 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 12:30:12.679710 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:30:12.679710 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 12:30:12.679710 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 12:30:12.679710 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 12:30:12.679710 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 12:30:12.679710 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 12:30:12.680886 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 12:30:12.680886 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 12:30:12.680886 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 12:30:12.680886 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 12:30:12.680886 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 12:30:12.680886 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 12:30:12.680886 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 12:30:12.680886 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 12:30:12.680886 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 12:30:12.680886 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 12:30:12.680886 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 12:30:12.680886 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 12:30:12.680886 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 12:30:12.680886 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 12:30:12.680886 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 12:30:12.680886 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 12:30:12.681944 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 12:30:12.681944 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application with Lock( Jul 27 12:30:12.681944 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 12:30:12.681944 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self._enter() Jul 27 12:30:12.681944 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 12:30:12.681944 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 12:30:12.681944 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 12:30:12.681944 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application return self.creator() Jul 27 12:30:12.681944 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 12:30:12.681944 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application created_value = creator( Jul 27 12:30:12.681944 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 12:30:12.681944 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 12:30:12.681944 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 12:30:12.681944 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: ERROR keystone.server.flask.application Jul 27 12:30:12.681944 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 461/925] 10.222.0.55 () {56 vars in 1117 bytes} [Wed Jul 27 12:30:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 12:30:12.687404 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d301cd-9697-458a-b64f-71bbcd1e4338 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:30:12.765400 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:30:12.788266 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d301cd-9697-458a-b64f-71bbcd1e4338 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:30:12.821383 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c2d78-6c91-4413-b4ac-d590f22b8c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:30:12.822035 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c2d78-6c91-4413-b4ac-d590f22b8c8b None admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:30:12.822321 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c2d78-6c91-4413-b4ac-d590f22b8c8b None admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:30:12.822596 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c2d78-6c91-4413-b4ac-d590f22b8c8b None admin] PATH_INFO: `/v3/services` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:30:12.823271 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c2d78-6c91-4413-b4ac-d590f22b8c8b None admin] RBAC: Adding query filter params (name=placement) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:30:12.823576 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c2d78-6c91-4413-b4ac-d590f22b8c8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:30:12.824939 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c2d78-6c91-4413-b4ac-d590f22b8c8b None admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:30:12.829913 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 465/926] 10.222.0.55 () {56 vars in 1116 bytes} [Wed Jul 27 12:30:12 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:30:12.835842 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cfed99-d855-49bb-9c3f-2684400c8dc3 None admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:30:12.935942 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cfed99-d855-49bb-9c3f-2684400c8dc3 None admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:30:12.968439 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833adc3-fe29-4ba7-ae67-31a021d6a100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:30:12.969157 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833adc3-fe29-4ba7-ae67-31a021d6a100 None admin] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:30:12.969482 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833adc3-fe29-4ba7-ae67-31a021d6a100 None admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:30:12.969798 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833adc3-fe29-4ba7-ae67-31a021d6a100 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:30:12.970650 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833adc3-fe29-4ba7-ae67-31a021d6a100 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:30:12.972016 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833adc3-fe29-4ba7-ae67-31a021d6a100 None admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:30:12.991914 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 462/927] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Jul 27 12:30:12 2022] POST /identity/v3/endpoints => generated 331 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 12:30:22.828083 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=30 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:30:22.987803 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:31:11.350749 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2c307-c476-4ab7-a1a7-c0fd6fb107b2 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:11.351315 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2c307-c476-4ab7-a1a7-c0fd6fb107b2 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:11.351315 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2c307-c476-4ab7-a1a7-c0fd6fb107b2 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:11.358592 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8825f44-ac02-491a-8487-cbd30c5329c8 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:11.359005 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8825f44-ac02-491a-8487-cbd30c5329c8 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:11.359157 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8825f44-ac02-491a-8487-cbd30c5329c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:11.361821 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 466/928] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:31:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:31:11.380866 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-d8825f44-ac02-491a-8487-cbd30c5329c8 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:31:11.382273 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-d8825f44-ac02-491a-8487-cbd30c5329c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:31:11.477014 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 463/929] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:31:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 12:31:11.536636 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cef44-b2fe-451a-bdbb-b68e43dc2070 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:11.537018 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cef44-b2fe-451a-bdbb-b68e43dc2070 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:11.537354 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cef44-b2fe-451a-bdbb-b68e43dc2070 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:11.539107 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 467/930] 10.222.0.55 () {54 vars in 965 bytes} [Wed Jul 27 12:31:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:31:11.546126 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630f6ff-56be-4603-a827-d25245b3f8ad None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:11.546608 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630f6ff-56be-4603-a827-d25245b3f8ad None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:11.547035 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630f6ff-56be-4603-a827-d25245b3f8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:11.621123 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-6630f6ff-56be-4603-a827-d25245b3f8ad None None] MFA Rules not processed for user `645587202a91426c98f86abdcddce8cd`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:31:11.622364 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-6630f6ff-56be-4603-a827-d25245b3f8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:31:11.695654 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 464/931] 10.222.0.55 () {58 vars in 1062 bytes} [Wed Jul 27 12:31:11 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:31:11.705990 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3cef44-b2fe-451a-bdbb-b68e43dc2070 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:31:11.722721 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3cef44-b2fe-451a-bdbb-b68e43dc2070 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:31:11.726583 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3eb81e-60ca-4e7f-9e95-2bc1fab663f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645587202a91426c98f86abdcddce8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:31:11.727319 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3eb81e-60ca-4e7f-9e95-2bc1fab663f9 service neutron] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:11.727688 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3eb81e-60ca-4e7f-9e95-2bc1fab663f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:11.728084 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3eb81e-60ca-4e7f-9e95-2bc1fab663f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:11.739499 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3eb81e-60ca-4e7f-9e95-2bc1fab663f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:31:11.741191 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3eb81e-60ca-4e7f-9e95-2bc1fab663f9 service neutron] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:31:11.752898 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 468/932] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:31:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:31:14.277213 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61730a8-46b5-4021-a8dc-70f93f176d56 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:14.277766 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61730a8-46b5-4021-a8dc-70f93f176d56 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:14.277866 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61730a8-46b5-4021-a8dc-70f93f176d56 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:14.279180 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 465/933] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:31:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:31:14.284414 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3eb577-0fdd-46d8-923d-6dcd5dce4862 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:14.284834 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3eb577-0fdd-46d8-923d-6dcd5dce4862 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:14.285094 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3eb577-0fdd-46d8-923d-6dcd5dce4862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:14.303924 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-aa3eb577-0fdd-46d8-923d-6dcd5dce4862 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:31:14.305121 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-aa3eb577-0fdd-46d8-923d-6dcd5dce4862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:31:14.313298 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 469/934] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:31:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:31:14.353504 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61730a8-46b5-4021-a8dc-70f93f176d56 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:31:14.364865 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61730a8-46b5-4021-a8dc-70f93f176d56 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:31:14.368550 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce99c44-e3b4-4a96-830b-fa208134dbcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645587202a91426c98f86abdcddce8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:31:14.369150 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce99c44-e3b4-4a96-830b-fa208134dbcc service neutron] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:14.369432 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce99c44-e3b4-4a96-830b-fa208134dbcc service neutron] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:14.369741 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce99c44-e3b4-4a96-830b-fa208134dbcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:14.378612 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce99c44-e3b4-4a96-830b-fa208134dbcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:31:14.380157 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce99c44-e3b4-4a96-830b-fa208134dbcc service neutron] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:31:14.389762 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 466/935] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:31:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:31:16.938383 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70157d-7f95-48b1-a95f-c4971babd065 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:16.938897 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70157d-7f95-48b1-a95f-c4971babd065 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:16.938976 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70157d-7f95-48b1-a95f-c4971babd065 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:16.940519 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 470/936] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:31:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:31:16.945356 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513e149-1b76-4b56-bb75-39bc3c2293fa None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:16.945863 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513e149-1b76-4b56-bb75-39bc3c2293fa None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:16.946099 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513e149-1b76-4b56-bb75-39bc3c2293fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:16.984664 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-d513e149-1b76-4b56-bb75-39bc3c2293fa None None] MFA Rules not processed for user `4af0ab4ee85144758573e3303fe9cf81`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:31:16.985909 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-d513e149-1b76-4b56-bb75-39bc3c2293fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:31:17.027569 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:31:17.057643 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 467/937] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:31:16 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:31:17.097009 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70157d-7f95-48b1-a95f-c4971babd065 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:31:17.108556 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70157d-7f95-48b1-a95f-c4971babd065 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:31:17.112179 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac38b61-c847-40cf-894e-6963238147c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645587202a91426c98f86abdcddce8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:31:17.112863 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac38b61-c847-40cf-894e-6963238147c9 service neutron] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:17.113216 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac38b61-c847-40cf-894e-6963238147c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:17.113562 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac38b61-c847-40cf-894e-6963238147c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:17.123603 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac38b61-c847-40cf-894e-6963238147c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:31:17.125056 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac38b61-c847-40cf-894e-6963238147c9 service neutron] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:31:17.135161 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 471/938] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:31:17 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:31:20.037994 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8c680-6860-4ca0-8eb4-e203db93fb71 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:20.038509 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8c680-6860-4ca0-8eb4-e203db93fb71 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:20.038620 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8c680-6860-4ca0-8eb4-e203db93fb71 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:20.039914 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 468/939] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:31:20.045713 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bc5b5-40eb-4de2-82d4-549a38f0aa6a None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:20.046101 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bc5b5-40eb-4de2-82d4-549a38f0aa6a None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:20.046268 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bc5b5-40eb-4de2-82d4-549a38f0aa6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:20.065513 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-6b2bc5b5-40eb-4de2-82d4-549a38f0aa6a None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:31:20.067021 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-6b2bc5b5-40eb-4de2-82d4-549a38f0aa6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:31:20.132700 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 472/940] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:31:20 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:31:20.172064 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8c680-6860-4ca0-8eb4-e203db93fb71 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:31:20.183232 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8c680-6860-4ca0-8eb4-e203db93fb71 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:31:20.187328 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba7b4c-0f16-4741-91da-f61f4d6bd949 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645587202a91426c98f86abdcddce8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:31:20.187934 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba7b4c-0f16-4741-91da-f61f4d6bd949 service neutron] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:20.188220 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba7b4c-0f16-4741-91da-f61f4d6bd949 service neutron] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:20.188497 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba7b4c-0f16-4741-91da-f61f4d6bd949 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:20.197238 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba7b4c-0f16-4741-91da-f61f4d6bd949 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:31:20.198698 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba7b4c-0f16-4741-91da-f61f4d6bd949 service neutron] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:31:20.207941 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 469/941] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:31:20 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:31:23.097925 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4792ea-cbaf-40a4-af00-ec3b4fbd3e81 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:23.098482 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4792ea-cbaf-40a4-af00-ec3b4fbd3e81 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:23.098482 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4792ea-cbaf-40a4-af00-ec3b4fbd3e81 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:23.099853 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 473/942] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:31:23.104962 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562bf04-1514-44ac-b2ef-b373eb8d70be None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:23.105358 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562bf04-1514-44ac-b2ef-b373eb8d70be None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:23.105618 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562bf04-1514-44ac-b2ef-b373eb8d70be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:23.125512 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-a562bf04-1514-44ac-b2ef-b373eb8d70be None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:31:23.126749 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-a562bf04-1514-44ac-b2ef-b373eb8d70be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:31:23.134423 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 470/943] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:31:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:31:23.171268 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4792ea-cbaf-40a4-af00-ec3b4fbd3e81 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:31:23.181713 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4792ea-cbaf-40a4-af00-ec3b4fbd3e81 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:31:23.185749 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea28a13-e658-42ab-adf1-f46a93fadee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645587202a91426c98f86abdcddce8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:31:23.186387 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea28a13-e658-42ab-adf1-f46a93fadee7 service neutron] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:23.186669 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea28a13-e658-42ab-adf1-f46a93fadee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:23.186946 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea28a13-e658-42ab-adf1-f46a93fadee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:23.195685 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea28a13-e658-42ab-adf1-f46a93fadee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:31:23.197114 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea28a13-e658-42ab-adf1-f46a93fadee7 service neutron] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:31:23.206896 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 474/944] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:31:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:31:25.512193 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507eebbe-fa03-4372-a4d9-cfb6a47b7b1d None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:25.513329 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507eebbe-fa03-4372-a4d9-cfb6a47b7b1d None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:25.513329 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507eebbe-fa03-4372-a4d9-cfb6a47b7b1d None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:25.514591 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 471/945] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:31:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:31:25.519890 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea992411-6c81-40ed-9c81-c5d0067278eb None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:25.520384 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea992411-6c81-40ed-9c81-c5d0067278eb None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:25.520794 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea992411-6c81-40ed-9c81-c5d0067278eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:25.540412 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-ea992411-6c81-40ed-9c81-c5d0067278eb None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:31:25.541622 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-ea992411-6c81-40ed-9c81-c5d0067278eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:31:25.549484 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 475/946] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:31:25 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:31:25.586793 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507eebbe-fa03-4372-a4d9-cfb6a47b7b1d None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:31:25.597414 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507eebbe-fa03-4372-a4d9-cfb6a47b7b1d None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:31:25.600826 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199882b-6660-4b0e-a7f5-bcd765a7211a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645587202a91426c98f86abdcddce8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:31:25.601424 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199882b-6660-4b0e-a7f5-bcd765a7211a service neutron] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:25.601745 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199882b-6660-4b0e-a7f5-bcd765a7211a service neutron] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:25.602028 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199882b-6660-4b0e-a7f5-bcd765a7211a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:25.610815 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2199882b-6660-4b0e-a7f5-bcd765a7211a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:31:25.612237 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2199882b-6660-4b0e-a7f5-bcd765a7211a service neutron] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:31:25.622418 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 472/947] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:31:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:31:27.916825 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c077a6-24d4-4d92-b1c8-ce1d36a46411 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:27.917480 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c077a6-24d4-4d92-b1c8-ce1d36a46411 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:27.917480 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c077a6-24d4-4d92-b1c8-ce1d36a46411 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:27.918979 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 476/948] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:31:27.924065 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71109c59-1edf-4096-b059-2c88e39d55a4 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:27.924480 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71109c59-1edf-4096-b059-2c88e39d55a4 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:27.924628 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71109c59-1edf-4096-b059-2c88e39d55a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:27.943796 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-71109c59-1edf-4096-b059-2c88e39d55a4 None None] MFA Rules not processed for user `4af0ab4ee85144758573e3303fe9cf81`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:31:27.945287 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-71109c59-1edf-4096-b059-2c88e39d55a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:31:27.953966 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 473/949] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:31:27 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:31:27.991588 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c077a6-24d4-4d92-b1c8-ce1d36a46411 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:31:28.002916 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c077a6-24d4-4d92-b1c8-ce1d36a46411 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:31:28.006645 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684d676-d370-4868-a858-5e0dc7a933c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645587202a91426c98f86abdcddce8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:31:28.007259 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684d676-d370-4868-a858-5e0dc7a933c5 service neutron] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:28.007541 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684d676-d370-4868-a858-5e0dc7a933c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:28.007816 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684d676-d370-4868-a858-5e0dc7a933c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:28.018204 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7684d676-d370-4868-a858-5e0dc7a933c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:31:28.021677 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7684d676-d370-4868-a858-5e0dc7a933c5 service neutron] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:31:28.035060 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 477/950] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:31:27 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:31:30.491024 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee696eaa-0a93-4dbd-b177-4d62e44905e3 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:30.491568 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee696eaa-0a93-4dbd-b177-4d62e44905e3 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:30.491568 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee696eaa-0a93-4dbd-b177-4d62e44905e3 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:30.492942 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 474/951] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:31:30.499332 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc99de-3bdd-495c-8967-48b395a87059 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:30.499825 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc99de-3bdd-495c-8967-48b395a87059 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:30.499949 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc99de-3bdd-495c-8967-48b395a87059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:30.519264 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-d3cc99de-3bdd-495c-8967-48b395a87059 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:31:30.520503 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-d3cc99de-3bdd-495c-8967-48b395a87059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:31:30.528549 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 478/952] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:31:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:31:30.580201 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4bf4c-398c-4462-bc5e-21f37b6f99b2 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:30.580488 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4bf4c-398c-4462-bc5e-21f37b6f99b2 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:30.580764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4bf4c-398c-4462-bc5e-21f37b6f99b2 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:30.582212 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 475/953] 10.222.0.55 () {54 vars in 965 bytes} [Wed Jul 27 12:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:31:30.588581 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4996c-c80b-494f-891f-74ce351c270e None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:30.588866 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4996c-c80b-494f-891f-74ce351c270e None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:30.589145 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4996c-c80b-494f-891f-74ce351c270e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:30.610343 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-c6d4996c-c80b-494f-891f-74ce351c270e None None] MFA Rules not processed for user `645587202a91426c98f86abdcddce8cd`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:31:30.611583 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-c6d4996c-c80b-494f-891f-74ce351c270e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:31:30.618193 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 479/954] 10.222.0.55 () {58 vars in 1062 bytes} [Wed Jul 27 12:31:30 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:31:30.627995 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4bf4c-398c-4462-bc5e-21f37b6f99b2 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:31:30.638409 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4bf4c-398c-4462-bc5e-21f37b6f99b2 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:31:30.641834 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940eb15-fc01-466c-904a-f598283719c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645587202a91426c98f86abdcddce8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:31:30.642435 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940eb15-fc01-466c-904a-f598283719c0 service neutron] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:30.642717 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940eb15-fc01-466c-904a-f598283719c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:30.642990 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940eb15-fc01-466c-904a-f598283719c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:30.651729 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940eb15-fc01-466c-904a-f598283719c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:31:30.653165 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940eb15-fc01-466c-904a-f598283719c0 service neutron] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:31:30.662396 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 476/955] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:31:30 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:31:33.177676 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf0b6b-88fb-4d92-9a27-315f6c495997 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:33.178218 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf0b6b-88fb-4d92-9a27-315f6c495997 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:33.178218 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf0b6b-88fb-4d92-9a27-315f6c495997 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:33.179593 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 480/956] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:31:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:31:33.185158 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b30942-d0b5-4aa3-996c-4152754226d5 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:33.185580 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b30942-d0b5-4aa3-996c-4152754226d5 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:33.185782 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b30942-d0b5-4aa3-996c-4152754226d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:33.205057 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-80b30942-d0b5-4aa3-996c-4152754226d5 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:31:33.206263 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-80b30942-d0b5-4aa3-996c-4152754226d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:31:33.213835 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 477/957] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:31:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:31:33.254394 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf0b6b-88fb-4d92-9a27-315f6c495997 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:31:33.259708 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=68 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:31:33.266526 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf0b6b-88fb-4d92-9a27-315f6c495997 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:31:33.269978 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d39e21-d58d-472d-b50a-d2c4bb59267c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645587202a91426c98f86abdcddce8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:31:33.270584 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d39e21-d58d-472d-b50a-d2c4bb59267c service neutron] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:33.270867 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d39e21-d58d-472d-b50a-d2c4bb59267c service neutron] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:33.271146 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d39e21-d58d-472d-b50a-d2c4bb59267c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:33.280033 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d39e21-d58d-472d-b50a-d2c4bb59267c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:31:33.281521 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d39e21-d58d-472d-b50a-d2c4bb59267c service neutron] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:31:33.290950 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 481/958] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:31:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:31:36.199984 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2287f13-a176-4ecb-b722-b5789b060fb6 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:36.200546 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2287f13-a176-4ecb-b722-b5789b060fb6 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:36.200546 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2287f13-a176-4ecb-b722-b5789b060fb6 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:36.201945 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 478/959] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:31:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:31:36.207258 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e1382-5467-4e4c-8b52-3a178ab05cc8 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:36.207666 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e1382-5467-4e4c-8b52-3a178ab05cc8 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:36.207820 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e1382-5467-4e4c-8b52-3a178ab05cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:36.226821 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-1a4e1382-5467-4e4c-8b52-3a178ab05cc8 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:31:36.228019 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-1a4e1382-5467-4e4c-8b52-3a178ab05cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:31:36.236375 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 482/960] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:31:36 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:31:36.273970 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2287f13-a176-4ecb-b722-b5789b060fb6 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:31:36.285537 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2287f13-a176-4ecb-b722-b5789b060fb6 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:31:36.289080 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac49f240-9f83-4801-8a44-876348bb55dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645587202a91426c98f86abdcddce8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:31:36.289727 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49f240-9f83-4801-8a44-876348bb55dc service neutron] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:36.290006 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49f240-9f83-4801-8a44-876348bb55dc service neutron] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:36.290282 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49f240-9f83-4801-8a44-876348bb55dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:36.299217 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac49f240-9f83-4801-8a44-876348bb55dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:31:36.300677 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac49f240-9f83-4801-8a44-876348bb55dc service neutron] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:31:36.310488 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 479/961] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:31:36 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 12:31:40.592822 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee071cc6-6906-4e96-88bc-a1949d40410a None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:40.593316 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee071cc6-6906-4e96-88bc-a1949d40410a None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:40.593316 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee071cc6-6906-4e96-88bc-a1949d40410a None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:40.594659 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 483/962] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 12:31:40.599784 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb5217-71bc-4036-a33b-190542730b9c None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:40.600197 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb5217-71bc-4036-a33b-190542730b9c None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:40.600336 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb5217-71bc-4036-a33b-190542730b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:40.619611 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-14bb5217-71bc-4036-a33b-190542730b9c None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:31:40.620773 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-14bb5217-71bc-4036-a33b-190542730b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:31:40.628308 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 480/963] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:31:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:31:40.667841 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee071cc6-6906-4e96-88bc-a1949d40410a None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:31:40.678907 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee071cc6-6906-4e96-88bc-a1949d40410a None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:31:40.682394 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ea3e5-581b-44cf-9bee-2342aaa98499 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645587202a91426c98f86abdcddce8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:31:40.682998 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ea3e5-581b-44cf-9bee-2342aaa98499 service neutron] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:40.683280 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ea3e5-581b-44cf-9bee-2342aaa98499 service neutron] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:40.683556 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ea3e5-581b-44cf-9bee-2342aaa98499 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:40.692626 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ea3e5-581b-44cf-9bee-2342aaa98499 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:31:40.694161 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ea3e5-581b-44cf-9bee-2342aaa98499 service neutron] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:31:40.703595 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 484/964] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:31:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:31:43.560381 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804947ef-71c5-40c0-a170-a4d6db41c7df None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:43.560883 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804947ef-71c5-40c0-a170-a4d6db41c7df None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:43.560975 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804947ef-71c5-40c0-a170-a4d6db41c7df None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:43.562319 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 481/965] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:31:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:31:43.567491 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f753be-5240-4878-a4b5-56665fc34d4d None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:43.567906 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f753be-5240-4878-a4b5-56665fc34d4d None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:43.568074 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f753be-5240-4878-a4b5-56665fc34d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:43.586937 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-38f753be-5240-4878-a4b5-56665fc34d4d None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:31:43.588244 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-38f753be-5240-4878-a4b5-56665fc34d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:31:43.596570 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 485/966] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:31:43 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:31:43.638065 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804947ef-71c5-40c0-a170-a4d6db41c7df None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:31:43.648622 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804947ef-71c5-40c0-a170-a4d6db41c7df None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:31:43.652001 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf1200-7930-40ac-a268-de55dffd48f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645587202a91426c98f86abdcddce8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:31:43.652600 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf1200-7930-40ac-a268-de55dffd48f5 service neutron] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:43.653400 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf1200-7930-40ac-a268-de55dffd48f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:43.653705 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf1200-7930-40ac-a268-de55dffd48f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:43.662402 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf1200-7930-40ac-a268-de55dffd48f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:31:43.663813 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf1200-7930-40ac-a268-de55dffd48f5 service neutron] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:31:43.674202 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 482/967] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:31:43 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:31:47.891231 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff697b65-0ccb-4cb0-b85f-fb35dbc4751f None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:47.891767 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff697b65-0ccb-4cb0-b85f-fb35dbc4751f None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:47.891767 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff697b65-0ccb-4cb0-b85f-fb35dbc4751f None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:47.893142 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 486/968] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:31:47.898336 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d3efa-9b6d-4569-b4b5-25a047f623a8 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:47.898752 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d3efa-9b6d-4569-b4b5-25a047f623a8 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:47.898898 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d3efa-9b6d-4569-b4b5-25a047f623a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:47.906937 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=54 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:31:47.919607 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-8b5d3efa-9b6d-4569-b4b5-25a047f623a8 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:31:47.920791 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-8b5d3efa-9b6d-4569-b4b5-25a047f623a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:31:47.928486 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 483/969] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:31:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:31:47.967981 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff697b65-0ccb-4cb0-b85f-fb35dbc4751f None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:31:47.978557 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff697b65-0ccb-4cb0-b85f-fb35dbc4751f None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:31:47.982135 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523431cc-5fdc-4a56-82af-01d8567bf584 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645587202a91426c98f86abdcddce8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:31:47.982775 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523431cc-5fdc-4a56-82af-01d8567bf584 service neutron] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:47.983103 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523431cc-5fdc-4a56-82af-01d8567bf584 service neutron] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:47.983375 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523431cc-5fdc-4a56-82af-01d8567bf584 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:47.992873 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523431cc-5fdc-4a56-82af-01d8567bf584 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:31:47.994630 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523431cc-5fdc-4a56-82af-01d8567bf584 service neutron] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:31:48.004334 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 487/970] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:31:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:31:53.444663 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759204f-38c8-4f7e-a51a-534597a13683 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:53.445155 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759204f-38c8-4f7e-a51a-534597a13683 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:53.445273 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759204f-38c8-4f7e-a51a-534597a13683 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:53.446851 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 484/971] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jul 27 12:31:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:31:53.452310 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46352e-8b76-4d78-9306-6f03bb185dad None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:53.452707 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46352e-8b76-4d78-9306-6f03bb185dad None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:53.452888 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46352e-8b76-4d78-9306-6f03bb185dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:53.530628 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-fb46352e-8b76-4d78-9306-6f03bb185dad None None] MFA Rules not processed for user `6cc3f626dcb5495c9eed35a8e50092e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:31:53.532188 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-fb46352e-8b76-4d78-9306-6f03bb185dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:31:53.610940 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 488/972] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jul 27 12:31:53 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:31:57.914799 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=2 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:31:58.041398 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ba9a5-9ffc-43dd-8b0d-7ffb9fcda5c5 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:58.042072 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ba9a5-9ffc-43dd-8b0d-7ffb9fcda5c5 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:58.042560 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ba9a5-9ffc-43dd-8b0d-7ffb9fcda5c5 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:58.045021 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 485/973] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jul 27 12:31:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:31:58.050604 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84529d1c-7e93-4d41-a818-9222ff5bece2 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:58.051468 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84529d1c-7e93-4d41-a818-9222ff5bece2 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:58.051903 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84529d1c-7e93-4d41-a818-9222ff5bece2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:58.082586 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-84529d1c-7e93-4d41-a818-9222ff5bece2 None None] MFA Rules not processed for user `6cc3f626dcb5495c9eed35a8e50092e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:31:58.083878 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-84529d1c-7e93-4d41-a818-9222ff5bece2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:31:58.094022 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 489/974] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jul 27 12:31:58 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:31:59.607289 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836730a-4ce0-4162-9d74-63f5cf6f439a None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:59.607865 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836730a-4ce0-4162-9d74-63f5cf6f439a None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:59.607865 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836730a-4ce0-4162-9d74-63f5cf6f439a None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:59.609176 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 486/975] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jul 27 12:31:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:31:59.614064 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1f9e8-1443-40a5-9115-a1fc2d606c7a None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:31:59.614507 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1f9e8-1443-40a5-9115-a1fc2d606c7a None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:31:59.614606 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1f9e8-1443-40a5-9115-a1fc2d606c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:31:59.634977 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-c8e1f9e8-1443-40a5-9115-a1fc2d606c7a None None] MFA Rules not processed for user `6cc3f626dcb5495c9eed35a8e50092e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:31:59.636262 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-c8e1f9e8-1443-40a5-9115-a1fc2d606c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:31:59.645130 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 490/976] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jul 27 12:31:59 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 12:32:03.684425 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4622274-ba65-4d69-aea0-a00e45faa594 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:03.684956 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4622274-ba65-4d69-aea0-a00e45faa594 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:03.688489 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4622274-ba65-4d69-aea0-a00e45faa594 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:03.690502 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 487/977] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:32:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:32:03.692071 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f17642-9856-4652-8d9c-34e47b89d97a None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:03.692511 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f17642-9856-4652-8d9c-34e47b89d97a None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:03.692703 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f17642-9856-4652-8d9c-34e47b89d97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:03.703247 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=69 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:32:03.716093 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-d9f17642-9856-4652-8d9c-34e47b89d97a None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:32:03.718170 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-d9f17642-9856-4652-8d9c-34e47b89d97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:32:03.733927 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 491/978] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:32:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:32:03.784335 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b51202-ed02-4abd-a88d-bd99fed9a991 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:03.785065 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b51202-ed02-4abd-a88d-bd99fed9a991 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:03.785547 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b51202-ed02-4abd-a88d-bd99fed9a991 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:03.787711 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 488/979] 10.222.0.55 () {54 vars in 962 bytes} [Wed Jul 27 12:32:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:32:03.796693 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d7fb5-da8c-40d8-a33a-6ad8d3731a36 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:03.797501 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d7fb5-da8c-40d8-a33a-6ad8d3731a36 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:03.799024 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d7fb5-da8c-40d8-a33a-6ad8d3731a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:03.843529 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-ca0d7fb5-da8c-40d8-a33a-6ad8d3731a36 None None] MFA Rules not processed for user `36964c4644584d4282b04596ad20717c`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:32:03.844807 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-ca0d7fb5-da8c-40d8-a33a-6ad8d3731a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:32:03.921278 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 492/980] 10.222.0.55 () {58 vars in 1059 bytes} [Wed Jul 27 12:32:03 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:32:03.929483 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b51202-ed02-4abd-a88d-bd99fed9a991 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:32:03.944019 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b51202-ed02-4abd-a88d-bd99fed9a991 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:32:03.948776 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239062ad-d440-4b68-88f9-a3f44a637b86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36964c4644584d4282b04596ad20717c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:32:03.950084 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239062ad-d440-4b68-88f9-a3f44a637b86 service nova] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:03.950436 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239062ad-d440-4b68-88f9-a3f44a637b86 service nova] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:03.950802 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239062ad-d440-4b68-88f9-a3f44a637b86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:03.958838 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239062ad-d440-4b68-88f9-a3f44a637b86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:32:03.960478 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239062ad-d440-4b68-88f9-a3f44a637b86 service nova] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:32:03.970232 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 489/981] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:32:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:32:06.487992 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d5557-4790-4631-a840-713c4782668f None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:06.488497 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d5557-4790-4631-a840-713c4782668f None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:06.488589 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d5557-4790-4631-a840-713c4782668f None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:06.490170 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 493/982] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:32:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:32:06.495461 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19af288-8a48-4385-94c5-a361c02f159d None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:06.495848 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19af288-8a48-4385-94c5-a361c02f159d None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:06.496097 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19af288-8a48-4385-94c5-a361c02f159d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:06.515462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-d19af288-8a48-4385-94c5-a361c02f159d None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:32:06.516665 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-d19af288-8a48-4385-94c5-a361c02f159d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:32:06.524734 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 490/983] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:32:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:32:06.569850 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d5557-4790-4631-a840-713c4782668f None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:32:06.584425 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d5557-4790-4631-a840-713c4782668f None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:32:06.590612 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4914084-f475-4d50-a66a-eee050515d71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36964c4644584d4282b04596ad20717c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:32:06.591328 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4914084-f475-4d50-a66a-eee050515d71 service nova] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:06.591706 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4914084-f475-4d50-a66a-eee050515d71 service nova] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:06.592012 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4914084-f475-4d50-a66a-eee050515d71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:06.605874 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4914084-f475-4d50-a66a-eee050515d71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:32:06.607525 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4914084-f475-4d50-a66a-eee050515d71 service nova] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:32:06.618364 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 494/984] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:32:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:32:09.171130 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04528d38-ec8a-4eb4-967e-33363ade8504 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:09.171628 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04528d38-ec8a-4eb4-967e-33363ade8504 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:09.171967 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04528d38-ec8a-4eb4-967e-33363ade8504 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:09.173419 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 491/985] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:32:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:32:09.178803 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217b222-742a-4b18-8de9-af81d204a5ef None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:09.179208 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217b222-742a-4b18-8de9-af81d204a5ef None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:09.179427 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217b222-742a-4b18-8de9-af81d204a5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:09.199830 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-0217b222-742a-4b18-8de9-af81d204a5ef None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:32:09.201028 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-0217b222-742a-4b18-8de9-af81d204a5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:32:09.208908 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 495/986] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:32:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:32:09.255336 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ac285-de9e-442c-8068-80f0346f0563 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:09.255653 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ac285-de9e-442c-8068-80f0346f0563 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:09.255935 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ac285-de9e-442c-8068-80f0346f0563 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:09.257265 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 492/987] 10.222.0.55 () {54 vars in 962 bytes} [Wed Jul 27 12:32:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:32:09.269021 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec8b8b-ad34-4335-8917-3ddff7fd82b2 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:09.269307 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec8b8b-ad34-4335-8917-3ddff7fd82b2 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:09.269881 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec8b8b-ad34-4335-8917-3ddff7fd82b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:09.291020 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-ffec8b8b-ad34-4335-8917-3ddff7fd82b2 None None] MFA Rules not processed for user `36964c4644584d4282b04596ad20717c`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:32:09.292210 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-ffec8b8b-ad34-4335-8917-3ddff7fd82b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:32:09.300876 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 496/988] 10.222.0.55 () {58 vars in 1059 bytes} [Wed Jul 27 12:32:09 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:32:09.309273 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ac285-de9e-442c-8068-80f0346f0563 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:32:09.325884 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ac285-de9e-442c-8068-80f0346f0563 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:32:09.330712 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d990bd-c4e0-4777-b737-161f5669f266 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36964c4644584d4282b04596ad20717c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:32:09.331310 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d990bd-c4e0-4777-b737-161f5669f266 service nova] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:09.331588 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d990bd-c4e0-4777-b737-161f5669f266 service nova] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:09.331859 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d990bd-c4e0-4777-b737-161f5669f266 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:09.344278 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d990bd-c4e0-4777-b737-161f5669f266 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:32:09.345923 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d990bd-c4e0-4777-b737-161f5669f266 service nova] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:32:09.355859 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 493/989] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:32:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:32:11.687923 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e822f71-1541-425d-8f7f-56380a808f49 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:11.688881 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e822f71-1541-425d-8f7f-56380a808f49 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:11.689395 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e822f71-1541-425d-8f7f-56380a808f49 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:11.697663 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e1f7a-7e35-4fbc-9bdf-08e554b7f704 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:11.699817 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 497/990] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:32:11 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:32:11.699968 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e1f7a-7e35-4fbc-9bdf-08e554b7f704 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:11.700123 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e1f7a-7e35-4fbc-9bdf-08e554b7f704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:11.722153 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-759e1f7a-7e35-4fbc-9bdf-08e554b7f704 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:32:11.723714 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-759e1f7a-7e35-4fbc-9bdf-08e554b7f704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:32:11.734400 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 494/991] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:32:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 12:32:11.783121 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e822f71-1541-425d-8f7f-56380a808f49 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:32:11.797511 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e822f71-1541-425d-8f7f-56380a808f49 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:32:11.808932 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a9ca7-d230-460f-9c31-29857c546c53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36964c4644584d4282b04596ad20717c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:32:11.809981 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a9ca7-d230-460f-9c31-29857c546c53 service nova] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:11.810479 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a9ca7-d230-460f-9c31-29857c546c53 service nova] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:11.810986 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a9ca7-d230-460f-9c31-29857c546c53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:11.824713 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a9ca7-d230-460f-9c31-29857c546c53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:32:11.826842 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a9ca7-d230-460f-9c31-29857c546c53 service nova] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:32:11.853570 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 498/992] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:32:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:32:13.842795 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e4783-cf65-4738-80ee-697cd95e02bf None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:13.843247 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e4783-cf65-4738-80ee-697cd95e02bf None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:13.843325 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e4783-cf65-4738-80ee-697cd95e02bf None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:13.850195 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366da621-a363-4473-8b3a-471d4b3e46ad None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:13.850602 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366da621-a363-4473-8b3a-471d4b3e46ad None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:13.850754 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366da621-a363-4473-8b3a-471d4b3e46ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:13.853331 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 495/993] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:32:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:32:13.890018 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-366da621-a363-4473-8b3a-471d4b3e46ad None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:32:13.892968 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-366da621-a363-4473-8b3a-471d4b3e46ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:32:13.921262 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 499/994] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:32:13 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:32:14.232685 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27983e7-a38e-45d9-984f-94bc1f76f0a4 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:14.232974 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27983e7-a38e-45d9-984f-94bc1f76f0a4 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:14.233249 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27983e7-a38e-45d9-984f-94bc1f76f0a4 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:14.234625 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 496/995] 10.222.0.55 () {54 vars in 964 bytes} [Wed Jul 27 12:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:32:14.240064 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf66c1b-05f2-4f13-98e8-117e10cd6c15 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:14.240425 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf66c1b-05f2-4f13-98e8-117e10cd6c15 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:14.240781 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf66c1b-05f2-4f13-98e8-117e10cd6c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:14.270665 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fe634-2fb4-4553-aae2-241db45567e4 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:14.271232 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fe634-2fb4-4553-aae2-241db45567e4 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:14.271543 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fe634-2fb4-4553-aae2-241db45567e4 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:14.272890 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 497/996] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 12:32:14.278628 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718014f8-21df-47d6-a92d-3d1efd5deb71 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:14.278916 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718014f8-21df-47d6-a92d-3d1efd5deb71 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:14.279198 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718014f8-21df-47d6-a92d-3d1efd5deb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:14.281493 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-cbf66c1b-05f2-4f13-98e8-117e10cd6c15 None None] MFA Rules not processed for user `e6ead01964e14f389bcfca4e9d9b6475`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:32:14.282739 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-cbf66c1b-05f2-4f13-98e8-117e10cd6c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:32:14.299905 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-718014f8-21df-47d6-a92d-3d1efd5deb71 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:32:14.301121 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-718014f8-21df-47d6-a92d-3d1efd5deb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:32:14.309416 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 498/997] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:32:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 12:32:14.353137 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 500/998] 10.222.0.55 () {58 vars in 1061 bytes} [Wed Jul 27 12:32:14 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:32:14.359003 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718014f8-21df-47d6-a92d-3d1efd5deb71 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:32:14.361771 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf66c1b-05f2-4f13-98e8-117e10cd6c15 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:32:14.370271 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf66c1b-05f2-4f13-98e8-117e10cd6c15 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:32:14.372523 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718014f8-21df-47d6-a92d-3d1efd5deb71 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:32:14.374115 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7e701-740a-46cb-b3a7-05805e73956d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ead01964e14f389bcfca4e9d9b6475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:32:14.374764 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7e701-740a-46cb-b3a7-05805e73956d service cinder] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:14.375046 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7e701-740a-46cb-b3a7-05805e73956d service cinder] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:14.375322 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7e701-740a-46cb-b3a7-05805e73956d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:14.378761 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18fb7e-3653-44fa-8c13-56353a1275e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36964c4644584d4282b04596ad20717c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:32:14.379487 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18fb7e-3653-44fa-8c13-56353a1275e1 service nova] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:14.379842 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18fb7e-3653-44fa-8c13-56353a1275e1 service nova] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:14.380190 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18fb7e-3653-44fa-8c13-56353a1275e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:14.385370 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b7e701-740a-46cb-b3a7-05805e73956d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:32:14.386955 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b7e701-740a-46cb-b3a7-05805e73956d service cinder] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:32:14.389430 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b18fb7e-3653-44fa-8c13-56353a1275e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:32:14.391060 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b18fb7e-3653-44fa-8c13-56353a1275e1 service nova] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:32:14.391359 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=100 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:32:14.401212 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 499/999] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:32:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:32:14.401679 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 501/1000] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:32:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:32:16.695777 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682e150-aa25-43b5-911e-9b81f945c92f None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:16.696211 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682e150-aa25-43b5-911e-9b81f945c92f None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:16.696346 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682e150-aa25-43b5-911e-9b81f945c92f None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:16.698109 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 500/1001] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:32:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:32:16.704052 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96e196-5e12-4865-8056-02206d4c1ed2 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:16.704494 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96e196-5e12-4865-8056-02206d4c1ed2 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:16.704589 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96e196-5e12-4865-8056-02206d4c1ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:16.725122 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-0a96e196-5e12-4865-8056-02206d4c1ed2 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:32:16.726370 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-0a96e196-5e12-4865-8056-02206d4c1ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:32:16.734687 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 502/1002] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:32:16 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:32:16.781729 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7682e150-aa25-43b5-911e-9b81f945c92f None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:32:16.795151 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7682e150-aa25-43b5-911e-9b81f945c92f None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:32:16.800358 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af441858-642f-4535-805b-42562d58e94b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36964c4644584d4282b04596ad20717c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:32:16.800983 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af441858-642f-4535-805b-42562d58e94b service nova] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:16.801265 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af441858-642f-4535-805b-42562d58e94b service nova] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:16.801569 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af441858-642f-4535-805b-42562d58e94b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:16.811573 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af441858-642f-4535-805b-42562d58e94b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:32:16.813194 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af441858-642f-4535-805b-42562d58e94b service nova] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:32:16.823519 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 501/1003] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:32:16 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:32:19.092549 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da2663-0216-4fb0-b42a-f1ed87e89aed None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:19.093103 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da2663-0216-4fb0-b42a-f1ed87e89aed None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:19.093103 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da2663-0216-4fb0-b42a-f1ed87e89aed None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:19.094476 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 503/1004] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:32:19.099822 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793f4c2-52bf-4791-b704-460756e33e0f None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:19.100245 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793f4c2-52bf-4791-b704-460756e33e0f None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:19.100441 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793f4c2-52bf-4791-b704-460756e33e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:19.120406 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-a793f4c2-52bf-4791-b704-460756e33e0f None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:32:19.121760 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-a793f4c2-52bf-4791-b704-460756e33e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:32:19.134133 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 502/1005] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:32:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:32:19.180442 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da2663-0216-4fb0-b42a-f1ed87e89aed None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:32:19.194382 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da2663-0216-4fb0-b42a-f1ed87e89aed None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:32:19.200281 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe1d22-dec8-4097-8023-e5e106775c37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36964c4644584d4282b04596ad20717c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:32:19.200931 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe1d22-dec8-4097-8023-e5e106775c37 service nova] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:19.201210 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe1d22-dec8-4097-8023-e5e106775c37 service nova] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:19.201516 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe1d22-dec8-4097-8023-e5e106775c37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:19.210714 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe1d22-dec8-4097-8023-e5e106775c37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:32:19.212345 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe1d22-dec8-4097-8023-e5e106775c37 service nova] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:32:19.223335 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 504/1006] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:32:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:32:21.467103 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d767ed-90c5-4d31-8765-35cc74bd5c4f None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:21.467632 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d767ed-90c5-4d31-8765-35cc74bd5c4f None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:21.467714 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d767ed-90c5-4d31-8765-35cc74bd5c4f None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:21.469023 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 503/1007] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:32:21.474396 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d163452-6e75-4839-87bc-95c6aff223a4 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:21.474787 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d163452-6e75-4839-87bc-95c6aff223a4 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:21.474969 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d163452-6e75-4839-87bc-95c6aff223a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:21.494987 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-0d163452-6e75-4839-87bc-95c6aff223a4 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:32:21.496698 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-0d163452-6e75-4839-87bc-95c6aff223a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:32:21.504962 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 505/1008] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:32:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:32:21.551317 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d767ed-90c5-4d31-8765-35cc74bd5c4f None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:32:21.566436 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d767ed-90c5-4d31-8765-35cc74bd5c4f None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:32:21.571442 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f934a-34de-40c5-8183-462d0bda7931 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36964c4644584d4282b04596ad20717c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:32:21.572071 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f934a-34de-40c5-8183-462d0bda7931 service nova] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:21.572355 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f934a-34de-40c5-8183-462d0bda7931 service nova] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:21.572632 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f934a-34de-40c5-8183-462d0bda7931 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:21.581557 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f934a-34de-40c5-8183-462d0bda7931 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:32:21.583176 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f934a-34de-40c5-8183-462d0bda7931 service nova] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:32:21.593343 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 504/1009] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:32:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:32:24.102424 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a54f9-3f61-489f-9635-770a367238fa None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:24.109489 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a54f9-3f61-489f-9635-770a367238fa None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:24.109489 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a54f9-3f61-489f-9635-770a367238fa None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:24.109489 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 506/1010] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:32:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:32:24.109792 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea3dde-e367-44ba-8522-cdfe48514d20 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:24.110192 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea3dde-e367-44ba-8522-cdfe48514d20 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:24.110355 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea3dde-e367-44ba-8522-cdfe48514d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:24.130600 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-d1ea3dde-e367-44ba-8522-cdfe48514d20 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:32:24.131749 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-d1ea3dde-e367-44ba-8522-cdfe48514d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:32:24.140462 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 505/1011] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:32:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:32:24.198364 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a54f9-3f61-489f-9635-770a367238fa None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:32:24.214418 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a54f9-3f61-489f-9635-770a367238fa None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:32:24.220760 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209ba1f-7490-4975-806c-6f7564ec429c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36964c4644584d4282b04596ad20717c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:32:24.221584 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209ba1f-7490-4975-806c-6f7564ec429c service nova] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:24.222149 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209ba1f-7490-4975-806c-6f7564ec429c service nova] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:24.222526 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209ba1f-7490-4975-806c-6f7564ec429c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:24.233355 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4209ba1f-7490-4975-806c-6f7564ec429c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:32:24.235467 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4209ba1f-7490-4975-806c-6f7564ec429c service nova] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:32:24.248712 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 507/1012] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:32:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:32:26.772651 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e83278-50e6-401f-82d5-4053e6ad3048 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:26.773296 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e83278-50e6-401f-82d5-4053e6ad3048 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:26.773633 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e83278-50e6-401f-82d5-4053e6ad3048 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:26.775859 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 506/1013] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:32:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:32:26.781035 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cc45b-0bb0-4c80-a2bf-7d1378282676 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:26.781831 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cc45b-0bb0-4c80-a2bf-7d1378282676 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:26.781831 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cc45b-0bb0-4c80-a2bf-7d1378282676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:26.803552 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-3c8cc45b-0bb0-4c80-a2bf-7d1378282676 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:32:26.805410 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-3c8cc45b-0bb0-4c80-a2bf-7d1378282676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:32:26.815201 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 508/1014] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:32:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:32:26.862704 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e83278-50e6-401f-82d5-4053e6ad3048 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:32:26.880778 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e83278-50e6-401f-82d5-4053e6ad3048 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:32:26.887876 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6cbe2-34dc-4aa6-8c2a-1491798cb195 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36964c4644584d4282b04596ad20717c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:32:26.888656 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6cbe2-34dc-4aa6-8c2a-1491798cb195 service nova] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:26.889018 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6cbe2-34dc-4aa6-8c2a-1491798cb195 service nova] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:26.889453 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6cbe2-34dc-4aa6-8c2a-1491798cb195 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:26.900170 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b6cbe2-34dc-4aa6-8c2a-1491798cb195 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:32:26.903101 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b6cbe2-34dc-4aa6-8c2a-1491798cb195 service nova] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:32:26.914487 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 507/1015] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:32:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:32:29.563863 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d80fd-aba1-47ef-99e7-221544cb5b65 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:29.564566 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d80fd-aba1-47ef-99e7-221544cb5b65 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:29.564566 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d80fd-aba1-47ef-99e7-221544cb5b65 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:29.565835 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 509/1016] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:32:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:32:29.571242 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a3cec-2711-4b05-8338-02266ad14736 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:29.571699 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a3cec-2711-4b05-8338-02266ad14736 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:29.571793 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a3cec-2711-4b05-8338-02266ad14736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:29.579808 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=52 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:32:29.593831 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-4d7a3cec-2711-4b05-8338-02266ad14736 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:32:29.595035 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-4d7a3cec-2711-4b05-8338-02266ad14736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:32:29.603242 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 508/1017] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:32:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:32:29.649308 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d80fd-aba1-47ef-99e7-221544cb5b65 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:32:29.663479 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d80fd-aba1-47ef-99e7-221544cb5b65 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:32:29.669105 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba10c3-4afc-47ef-9bcb-f0a279a8d9a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36964c4644584d4282b04596ad20717c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:32:29.669923 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba10c3-4afc-47ef-9bcb-f0a279a8d9a7 service nova] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:29.670199 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba10c3-4afc-47ef-9bcb-f0a279a8d9a7 service nova] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:29.670475 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba10c3-4afc-47ef-9bcb-f0a279a8d9a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:29.678951 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ba10c3-4afc-47ef-9bcb-f0a279a8d9a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:32:29.680567 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ba10c3-4afc-47ef-9bcb-f0a279a8d9a7 service nova] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:32:29.690113 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 510/1018] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:32:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:32:30.265655 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f34ed-5a82-4bbe-9938-2438ca5d6922 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:30.265947 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f34ed-5a82-4bbe-9938-2438ca5d6922 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:30.266229 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f34ed-5a82-4bbe-9938-2438ca5d6922 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:30.267632 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 509/1019] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:32:30.272887 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d46cd-edec-4bd3-9239-50729967d0f8 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:30.273177 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d46cd-edec-4bd3-9239-50729967d0f8 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:30.273461 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d46cd-edec-4bd3-9239-50729967d0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:30.292337 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-f77d46cd-edec-4bd3-9239-50729967d0f8 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:32:30.293540 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-f77d46cd-edec-4bd3-9239-50729967d0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:32:30.302266 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 511/1020] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:32:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:32:30.359444 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca9aa4-02d7-49c5-b430-fad05805231c None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:30.359733 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca9aa4-02d7-49c5-b430-fad05805231c None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:30.360015 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca9aa4-02d7-49c5-b430-fad05805231c None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:30.361350 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 510/1021] 10.222.0.55 () {54 vars in 966 bytes} [Wed Jul 27 12:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:32:30.366314 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7734361-0e44-4644-962d-766421e5b328 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:30.366608 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7734361-0e44-4644-962d-766421e5b328 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:30.366892 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7734361-0e44-4644-962d-766421e5b328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:30.405656 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-c7734361-0e44-4644-962d-766421e5b328 None None] MFA Rules not processed for user `a436eb33e8b040d192f1cfc9771fd351`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:32:30.406867 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-c7734361-0e44-4644-962d-766421e5b328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:32:30.470685 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 512/1022] 10.222.0.55 () {58 vars in 1063 bytes} [Wed Jul 27 12:32:30 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 12:32:30.478481 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca9aa4-02d7-49c5-b430-fad05805231c None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:32:30.489285 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca9aa4-02d7-49c5-b430-fad05805231c None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:32:30.492781 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828423b-5789-4920-a5bc-b0839dd0343b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a436eb33e8b040d192f1cfc9771fd351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:32:30.493385 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828423b-5789-4920-a5bc-b0839dd0343b service glance] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:30.493714 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828423b-5789-4920-a5bc-b0839dd0343b service glance] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:30.493995 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828423b-5789-4920-a5bc-b0839dd0343b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:30.503253 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828423b-5789-4920-a5bc-b0839dd0343b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:32:30.504671 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828423b-5789-4920-a5bc-b0839dd0343b service glance] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:32:30.514664 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 511/1023] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:32:30 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:32:31.976186 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c8b3d-4d06-4f80-b6c8-c07939aec8e5 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:31.976846 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c8b3d-4d06-4f80-b6c8-c07939aec8e5 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:31.976846 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c8b3d-4d06-4f80-b6c8-c07939aec8e5 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:31.978137 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 513/1024] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:32:31.984231 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e8abb-8716-4447-bf3d-ff1d1736fc0f None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:31.984823 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e8abb-8716-4447-bf3d-ff1d1736fc0f None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:31.984823 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e8abb-8716-4447-bf3d-ff1d1736fc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:32.007498 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-340e8abb-8716-4447-bf3d-ff1d1736fc0f None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:32:32.008712 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-340e8abb-8716-4447-bf3d-ff1d1736fc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:32:32.016444 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 512/1025] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:32:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:32:32.063233 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c8b3d-4d06-4f80-b6c8-c07939aec8e5 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:32:32.076991 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c8b3d-4d06-4f80-b6c8-c07939aec8e5 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:32:32.082032 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0ad0a-3e71-4f81-b674-af60b99a9db9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36964c4644584d4282b04596ad20717c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:32:32.082646 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0ad0a-3e71-4f81-b674-af60b99a9db9 service nova] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:32.082934 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0ad0a-3e71-4f81-b674-af60b99a9db9 service nova] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:32.083212 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0ad0a-3e71-4f81-b674-af60b99a9db9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:32.092726 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0ad0a-3e71-4f81-b674-af60b99a9db9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:32:32.094357 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0ad0a-3e71-4f81-b674-af60b99a9db9 service nova] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:32:32.103877 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 514/1026] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:32:32 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:32:42.000669 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=11 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:32:42.099676 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=70 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:32:45.710002 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533282b0-e766-4e78-880e-f2e0fcb933c2 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:45.710624 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533282b0-e766-4e78-880e-f2e0fcb933c2 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:45.710765 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533282b0-e766-4e78-880e-f2e0fcb933c2 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:45.712138 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 513/1027] 10.222.0.55 () {54 vars in 918 bytes} [Wed Jul 27 12:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:32:45.718135 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9b848-f715-438f-93c9-9d9f370f2e62 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:45.718598 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9b848-f715-438f-93c9-9d9f370f2e62 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:45.718832 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9b848-f715-438f-93c9-9d9f370f2e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:45.740186 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-21f9b848-f715-438f-93c9-9d9f370f2e62 None None] MFA Rules not processed for user `6cc3f626dcb5495c9eed35a8e50092e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:32:45.741413 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-21f9b848-f715-438f-93c9-9d9f370f2e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:32:45.750699 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 515/1028] 10.222.0.55 () {58 vars in 1015 bytes} [Wed Jul 27 12:32:45 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 12:32:45.765454 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54360287-dbfb-4f96-8929-24b90bfd8de0 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:45.765835 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54360287-dbfb-4f96-8929-24b90bfd8de0 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:45.766119 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54360287-dbfb-4f96-8929-24b90bfd8de0 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:45.767455 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 514/1029] 10.222.0.55 () {54 vars in 918 bytes} [Wed Jul 27 12:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 12:32:45.772086 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb53665-202a-4c37-9f36-91f472069b8d None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:45.772373 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb53665-202a-4c37-9f36-91f472069b8d None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:45.772681 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb53665-202a-4c37-9f36-91f472069b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:45.792020 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-cbb53665-202a-4c37-9f36-91f472069b8d None None] MFA Rules not processed for user `36964c4644584d4282b04596ad20717c`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:32:45.793218 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-cbb53665-202a-4c37-9f36-91f472069b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:32:45.801841 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 516/1030] 10.222.0.55 () {58 vars in 1015 bytes} [Wed Jul 27 12:32:45 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:32:48.462915 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbd6b8-b468-49c2-ac60-cff641a4fefc None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:48.463514 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbd6b8-b468-49c2-ac60-cff641a4fefc None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:48.463514 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbd6b8-b468-49c2-ac60-cff641a4fefc None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:48.464804 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 515/1031] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 12:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:32:48.469984 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debcccc7-92bb-42fc-9913-16ac4cee36b9 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:48.470407 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debcccc7-92bb-42fc-9913-16ac4cee36b9 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:48.470532 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debcccc7-92bb-42fc-9913-16ac4cee36b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:48.489464 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-debcccc7-92bb-42fc-9913-16ac4cee36b9 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:32:48.490679 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-debcccc7-92bb-42fc-9913-16ac4cee36b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:32:48.499175 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 517/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 12:32:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:32:48.541585 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cbd6b8-b468-49c2-ac60-cff641a4fefc None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:32:48.555692 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cbd6b8-b468-49c2-ac60-cff641a4fefc None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:32:48.561174 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659de02c-ad04-4926-955c-8c3c89f7dd1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36964c4644584d4282b04596ad20717c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:32:48.561798 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659de02c-ad04-4926-955c-8c3c89f7dd1d service nova] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:48.562080 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659de02c-ad04-4926-955c-8c3c89f7dd1d service nova] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:48.562352 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659de02c-ad04-4926-955c-8c3c89f7dd1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:48.570309 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659de02c-ad04-4926-955c-8c3c89f7dd1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:32:48.571867 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659de02c-ad04-4926-955c-8c3c89f7dd1d service nova] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:32:48.581383 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 516/1033] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:32:48 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:32:49.521324 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b9cfc-3117-4e4b-9d76-151409f198b9 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:49.521984 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b9cfc-3117-4e4b-9d76-151409f198b9 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:49.521984 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b9cfc-3117-4e4b-9d76-151409f198b9 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:49.523275 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 518/1034] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 12:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:32:49.528760 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d789c3-7d94-4b0e-a4e8-ce38a6c5d74a None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:49.529152 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d789c3-7d94-4b0e-a4e8-ce38a6c5d74a None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:49.529319 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d789c3-7d94-4b0e-a4e8-ce38a6c5d74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:49.548696 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-d0d789c3-7d94-4b0e-a4e8-ce38a6c5d74a None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:32:49.549943 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-d0d789c3-7d94-4b0e-a4e8-ce38a6c5d74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:32:49.557616 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 517/1035] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 12:32:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:32:49.772341 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b9cfc-3117-4e4b-9d76-151409f198b9 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:32:49.787039 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b9cfc-3117-4e4b-9d76-151409f198b9 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:32:49.792668 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41033e31-999f-4f81-a905-b03b1546e264 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36964c4644584d4282b04596ad20717c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:32:49.793223 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41033e31-999f-4f81-a905-b03b1546e264 service nova] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:49.793505 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41033e31-999f-4f81-a905-b03b1546e264 service nova] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:49.793809 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41033e31-999f-4f81-a905-b03b1546e264 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:49.802038 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41033e31-999f-4f81-a905-b03b1546e264 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:32:49.803618 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41033e31-999f-4f81-a905-b03b1546e264 service nova] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:32:49.812898 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 519/1036] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:32:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:32:50.712159 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d13a5d-7668-4b44-adbc-f1b582b4dd03 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:50.712622 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d13a5d-7668-4b44-adbc-f1b582b4dd03 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:50.712732 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d13a5d-7668-4b44-adbc-f1b582b4dd03 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:50.714096 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 518/1037] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 12:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:32:50.719011 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3aaa1e-31fb-41c7-9416-65e713fb97f9 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:50.719391 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3aaa1e-31fb-41c7-9416-65e713fb97f9 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:50.719579 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3aaa1e-31fb-41c7-9416-65e713fb97f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:50.740011 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-df3aaa1e-31fb-41c7-9416-65e713fb97f9 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:32:50.741147 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-df3aaa1e-31fb-41c7-9416-65e713fb97f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:32:50.749888 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 520/1038] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 12:32:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:32:50.905767 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d13a5d-7668-4b44-adbc-f1b582b4dd03 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:32:50.919899 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d13a5d-7668-4b44-adbc-f1b582b4dd03 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:32:50.924852 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c7446-ba6c-415f-9681-5a4d48c461f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36964c4644584d4282b04596ad20717c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:32:50.925460 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c7446-ba6c-415f-9681-5a4d48c461f8 service nova] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:50.925788 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c7446-ba6c-415f-9681-5a4d48c461f8 service nova] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:50.926069 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c7446-ba6c-415f-9681-5a4d48c461f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:50.934724 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4c7446-ba6c-415f-9681-5a4d48c461f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:32:50.936303 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4c7446-ba6c-415f-9681-5a4d48c461f8 service nova] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:32:50.945507 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 519/1039] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:32:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:32:51.829929 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8866a2-565d-41be-8d8d-e1457621409e None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:51.830479 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8866a2-565d-41be-8d8d-e1457621409e None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:51.830479 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8866a2-565d-41be-8d8d-e1457621409e None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:51.831823 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 521/1040] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 12:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:32:51.836660 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82b07b-854e-4920-9d74-7e7943178e70 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:51.837082 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82b07b-854e-4920-9d74-7e7943178e70 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:51.837224 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82b07b-854e-4920-9d74-7e7943178e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:51.856099 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-3b82b07b-854e-4920-9d74-7e7943178e70 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:32:51.857283 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-3b82b07b-854e-4920-9d74-7e7943178e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:32:51.865142 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 520/1041] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 12:32:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:32:52.021612 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8866a2-565d-41be-8d8d-e1457621409e None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:32:52.035261 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8866a2-565d-41be-8d8d-e1457621409e None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:32:52.040137 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973571c0-36e3-4511-9820-3a9b51e16f73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36964c4644584d4282b04596ad20717c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:32:52.040737 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973571c0-36e3-4511-9820-3a9b51e16f73 service nova] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:52.041019 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973571c0-36e3-4511-9820-3a9b51e16f73 service nova] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:52.041296 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973571c0-36e3-4511-9820-3a9b51e16f73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:52.049806 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973571c0-36e3-4511-9820-3a9b51e16f73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:32:52.051389 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973571c0-36e3-4511-9820-3a9b51e16f73 service nova] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:32:52.060655 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 522/1042] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:32:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:32:52.922567 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d942d5-d61e-4e59-a4a6-758af5645f31 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:52.923161 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d942d5-d61e-4e59-a4a6-758af5645f31 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:52.923161 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d942d5-d61e-4e59-a4a6-758af5645f31 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:52.924478 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 521/1043] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 12:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:32:52.929188 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b4605-5267-4590-ae54-a26bca705e18 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:52.929635 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b4605-5267-4590-ae54-a26bca705e18 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:52.929781 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b4605-5267-4590-ae54-a26bca705e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:52.948990 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-a53b4605-5267-4590-ae54-a26bca705e18 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:32:52.950194 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-a53b4605-5267-4590-ae54-a26bca705e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:32:52.957776 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 523/1044] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 12:32:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:32:53.116578 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d942d5-d61e-4e59-a4a6-758af5645f31 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:32:53.133238 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d942d5-d61e-4e59-a4a6-758af5645f31 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:32:53.138057 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f9ace-95cf-44b8-b122-aadb63513825 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36964c4644584d4282b04596ad20717c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:32:53.138660 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f9ace-95cf-44b8-b122-aadb63513825 service nova] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:53.138944 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f9ace-95cf-44b8-b122-aadb63513825 service nova] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:53.139222 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f9ace-95cf-44b8-b122-aadb63513825 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:53.147138 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4f9ace-95cf-44b8-b122-aadb63513825 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:32:53.148716 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4f9ace-95cf-44b8-b122-aadb63513825 service nova] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:32:53.157807 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 522/1045] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:32:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:32:53.961982 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24adc9b8-0edb-4576-a776-4fd3c236fc33 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:53.962492 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24adc9b8-0edb-4576-a776-4fd3c236fc33 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:53.962492 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24adc9b8-0edb-4576-a776-4fd3c236fc33 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:53.964316 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 524/1046] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 12:32:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:32:53.969097 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b9720-7eee-4cdd-8b80-ca4633ee580d None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:53.969495 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b9720-7eee-4cdd-8b80-ca4633ee580d None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:53.969799 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b9720-7eee-4cdd-8b80-ca4633ee580d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:53.989581 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-426b9720-7eee-4cdd-8b80-ca4633ee580d None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:32:53.990821 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-426b9720-7eee-4cdd-8b80-ca4633ee580d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:32:53.998860 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 523/1047] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 12:32:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:32:54.152960 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24adc9b8-0edb-4576-a776-4fd3c236fc33 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:32:54.166090 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24adc9b8-0edb-4576-a776-4fd3c236fc33 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:32:54.171670 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2341f484-ba74-4e35-a94b-a4859960c675 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36964c4644584d4282b04596ad20717c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:32:54.172274 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341f484-ba74-4e35-a94b-a4859960c675 service nova] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:54.172559 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341f484-ba74-4e35-a94b-a4859960c675 service nova] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:54.172832 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341f484-ba74-4e35-a94b-a4859960c675 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:54.180909 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2341f484-ba74-4e35-a94b-a4859960c675 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:32:54.182512 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2341f484-ba74-4e35-a94b-a4859960c675 service nova] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:32:54.191635 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 525/1048] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:32:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:32:55.013764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8e865-e5c2-42cc-a7fd-172c3ae5d98f None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:55.014337 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8e865-e5c2-42cc-a7fd-172c3ae5d98f None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:55.014337 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8e865-e5c2-42cc-a7fd-172c3ae5d98f None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:55.015704 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 524/1049] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 12:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:32:55.020748 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172156ae-70e9-4f61-8d7b-664d904975a7 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:55.021160 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172156ae-70e9-4f61-8d7b-664d904975a7 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:55.021335 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172156ae-70e9-4f61-8d7b-664d904975a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:55.041526 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-172156ae-70e9-4f61-8d7b-664d904975a7 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:32:55.042745 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-172156ae-70e9-4f61-8d7b-664d904975a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:32:55.050470 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 526/1050] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 12:32:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 12:32:55.205252 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8e865-e5c2-42cc-a7fd-172c3ae5d98f None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:32:55.219190 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8e865-e5c2-42cc-a7fd-172c3ae5d98f None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:32:55.224412 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7afd14-0269-43b8-bcf0-407ace5e0be9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36964c4644584d4282b04596ad20717c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:32:55.225034 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7afd14-0269-43b8-bcf0-407ace5e0be9 service nova] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:55.225322 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7afd14-0269-43b8-bcf0-407ace5e0be9 service nova] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:55.225624 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7afd14-0269-43b8-bcf0-407ace5e0be9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:55.234022 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7afd14-0269-43b8-bcf0-407ace5e0be9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:32:55.235607 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7afd14-0269-43b8-bcf0-407ace5e0be9 service nova] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:32:55.245178 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 525/1051] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:32:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:32:56.061824 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8b637-2266-4d80-90a5-167d4f9c93e1 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:56.062352 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8b637-2266-4d80-90a5-167d4f9c93e1 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:56.062470 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8b637-2266-4d80-90a5-167d4f9c93e1 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:56.063782 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 527/1052] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 12:32:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:32:56.068604 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5e84c-e643-4967-87da-86296903a2e4 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:56.068986 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5e84c-e643-4967-87da-86296903a2e4 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:56.069174 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5e84c-e643-4967-87da-86296903a2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:56.089044 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-7fb5e84c-e643-4967-87da-86296903a2e4 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:32:56.090305 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-7fb5e84c-e643-4967-87da-86296903a2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:32:56.098059 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 526/1053] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 12:32:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:32:56.257420 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8b637-2266-4d80-90a5-167d4f9c93e1 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:32:56.273858 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8b637-2266-4d80-90a5-167d4f9c93e1 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:32:56.278777 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad4789-56dc-46af-8c14-587eab0a0a8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36964c4644584d4282b04596ad20717c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:32:56.279384 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad4789-56dc-46af-8c14-587eab0a0a8a service nova] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:56.279666 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad4789-56dc-46af-8c14-587eab0a0a8a service nova] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:56.279939 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad4789-56dc-46af-8c14-587eab0a0a8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:56.287987 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad4789-56dc-46af-8c14-587eab0a0a8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:32:56.289563 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad4789-56dc-46af-8c14-587eab0a0a8a service nova] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:32:56.299500 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 528/1054] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:32:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:32:57.115529 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b8552-03f7-4247-bc22-f105a0f13c63 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:57.116094 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b8552-03f7-4247-bc22-f105a0f13c63 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:57.116094 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b8552-03f7-4247-bc22-f105a0f13c63 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:57.117447 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 527/1055] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 12:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:32:57.123052 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb06a83-2675-4621-a17e-2af2dc77e410 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:57.123470 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb06a83-2675-4621-a17e-2af2dc77e410 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:57.123599 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb06a83-2675-4621-a17e-2af2dc77e410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:57.143043 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-0fb06a83-2675-4621-a17e-2af2dc77e410 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:32:57.144214 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-0fb06a83-2675-4621-a17e-2af2dc77e410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:32:57.153013 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 529/1056] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 12:32:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:32:57.306853 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b8552-03f7-4247-bc22-f105a0f13c63 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:32:57.320620 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b8552-03f7-4247-bc22-f105a0f13c63 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:32:57.326073 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6fc80-2eb8-4194-b7cc-96b4fc2f08bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36964c4644584d4282b04596ad20717c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:32:57.326673 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6fc80-2eb8-4194-b7cc-96b4fc2f08bd service nova] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:57.326952 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6fc80-2eb8-4194-b7cc-96b4fc2f08bd service nova] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:57.327220 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6fc80-2eb8-4194-b7cc-96b4fc2f08bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:57.335102 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f6fc80-2eb8-4194-b7cc-96b4fc2f08bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:32:57.336700 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f6fc80-2eb8-4194-b7cc-96b4fc2f08bd service nova] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:32:57.345768 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 528/1057] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:32:57 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:32:59.437766 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c4ac9-85f8-448b-b06d-77a08c50ccfb None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:59.438342 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c4ac9-85f8-448b-b06d-77a08c50ccfb None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:59.438342 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c4ac9-85f8-448b-b06d-77a08c50ccfb None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:59.439656 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 530/1058] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 12:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:32:59.445008 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df94c42-24e9-42c9-959c-ac8f6987415e None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:59.445429 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df94c42-24e9-42c9-959c-ac8f6987415e None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:59.445568 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df94c42-24e9-42c9-959c-ac8f6987415e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:59.464850 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-7df94c42-24e9-42c9-959c-ac8f6987415e None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:32:59.466075 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-7df94c42-24e9-42c9-959c-ac8f6987415e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:32:59.473781 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 529/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 12:32:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:32:59.513477 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c4ac9-85f8-448b-b06d-77a08c50ccfb None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:32:59.523867 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c4ac9-85f8-448b-b06d-77a08c50ccfb None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:32:59.527524 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b3cda-5e6c-41ef-9bd4-7c63c28df481 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645587202a91426c98f86abdcddce8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:32:59.528129 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b3cda-5e6c-41ef-9bd4-7c63c28df481 service neutron] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:32:59.528409 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b3cda-5e6c-41ef-9bd4-7c63c28df481 service neutron] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:32:59.528687 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b3cda-5e6c-41ef-9bd4-7c63c28df481 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:32:59.537536 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b3cda-5e6c-41ef-9bd4-7c63c28df481 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:32:59.538977 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b3cda-5e6c-41ef-9bd4-7c63c28df481 service neutron] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:32:59.548051 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 531/1060] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:32:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:33:02.078095 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34747911-a4a6-4848-a75e-6205fd98fcc4 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:02.078652 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34747911-a4a6-4848-a75e-6205fd98fcc4 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:02.078652 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34747911-a4a6-4848-a75e-6205fd98fcc4 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:02.080049 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 530/1061] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 12:33:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:33:02.085326 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c30a8-0ae1-45c9-b79e-85f4241c10be None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:02.085776 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c30a8-0ae1-45c9-b79e-85f4241c10be None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:02.085910 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c30a8-0ae1-45c9-b79e-85f4241c10be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:02.106080 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-9c6c30a8-0ae1-45c9-b79e-85f4241c10be None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:33:02.107265 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-9c6c30a8-0ae1-45c9-b79e-85f4241c10be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:33:02.116338 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 532/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 12:33:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:33:02.156686 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34747911-a4a6-4848-a75e-6205fd98fcc4 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:33:02.167431 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34747911-a4a6-4848-a75e-6205fd98fcc4 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:33:02.170879 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc7849-9eb0-476f-8c67-c29feed2423e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645587202a91426c98f86abdcddce8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:33:02.171476 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc7849-9eb0-476f-8c67-c29feed2423e service neutron] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:02.171753 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc7849-9eb0-476f-8c67-c29feed2423e service neutron] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:02.172024 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc7849-9eb0-476f-8c67-c29feed2423e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:02.180683 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc7849-9eb0-476f-8c67-c29feed2423e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:33:02.182178 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc7849-9eb0-476f-8c67-c29feed2423e service neutron] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:33:02.191277 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 531/1063] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:33:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:33:04.708515 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1ed3f-4c05-4b33-af83-5e70b6c1fd33 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:04.708938 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1ed3f-4c05-4b33-af83-5e70b6c1fd33 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:04.709062 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1ed3f-4c05-4b33-af83-5e70b6c1fd33 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:04.710460 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 533/1064] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 12:33:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:33:04.716098 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cb17f-2337-416a-8e70-86a40e75e9c5 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:04.716488 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cb17f-2337-416a-8e70-86a40e75e9c5 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:04.716669 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cb17f-2337-416a-8e70-86a40e75e9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:04.735878 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-4b4cb17f-2337-416a-8e70-86a40e75e9c5 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:33:04.737074 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-4b4cb17f-2337-416a-8e70-86a40e75e9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:33:04.745090 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 532/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 12:33:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:33:04.784009 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1ed3f-4c05-4b33-af83-5e70b6c1fd33 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:33:04.795204 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1ed3f-4c05-4b33-af83-5e70b6c1fd33 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:33:04.798648 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8812e71f-949d-4656-adcf-5064350f65bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645587202a91426c98f86abdcddce8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:33:04.799243 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812e71f-949d-4656-adcf-5064350f65bd service neutron] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:04.799519 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812e71f-949d-4656-adcf-5064350f65bd service neutron] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:04.799818 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812e71f-949d-4656-adcf-5064350f65bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:04.808630 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8812e71f-949d-4656-adcf-5064350f65bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:33:04.810102 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8812e71f-949d-4656-adcf-5064350f65bd service neutron] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:33:04.821467 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 534/1066] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:33:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:33:07.157794 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11bc98-d646-4e64-b53a-892dc300cf42 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:07.158330 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11bc98-d646-4e64-b53a-892dc300cf42 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:07.158330 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11bc98-d646-4e64-b53a-892dc300cf42 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:07.159690 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 533/1067] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 12:33:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:33:07.164836 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7ff0f-ac61-4b07-915c-5e50cfb29c9b None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:07.165242 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7ff0f-ac61-4b07-915c-5e50cfb29c9b None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:07.165414 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7ff0f-ac61-4b07-915c-5e50cfb29c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:07.186341 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-35e7ff0f-ac61-4b07-915c-5e50cfb29c9b None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:33:07.187550 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-35e7ff0f-ac61-4b07-915c-5e50cfb29c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:33:07.195504 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 535/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 12:33:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:33:07.234787 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11bc98-d646-4e64-b53a-892dc300cf42 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:33:07.246707 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11bc98-d646-4e64-b53a-892dc300cf42 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:33:07.250171 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73964b40-0f34-4148-b2d6-cf761325a514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645587202a91426c98f86abdcddce8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:33:07.250777 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73964b40-0f34-4148-b2d6-cf761325a514 service neutron] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:07.251063 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73964b40-0f34-4148-b2d6-cf761325a514 service neutron] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:07.251339 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73964b40-0f34-4148-b2d6-cf761325a514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:07.260298 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73964b40-0f34-4148-b2d6-cf761325a514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:33:07.261750 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73964b40-0f34-4148-b2d6-cf761325a514 service neutron] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:33:07.273427 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 534/1069] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:33:07 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:33:09.539488 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33603cc3-88ec-428f-a0ab-7a85fcdd3178 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:09.540030 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33603cc3-88ec-428f-a0ab-7a85fcdd3178 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:09.540030 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33603cc3-88ec-428f-a0ab-7a85fcdd3178 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:09.541429 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 536/1070] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 12:33:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:33:09.546767 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103b79b-c610-4a2f-8da3-a6255e3b944c None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:09.547162 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103b79b-c610-4a2f-8da3-a6255e3b944c None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:09.547332 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103b79b-c610-4a2f-8da3-a6255e3b944c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:09.566702 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-b103b79b-c610-4a2f-8da3-a6255e3b944c None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:33:09.567896 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-b103b79b-c610-4a2f-8da3-a6255e3b944c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:33:09.576210 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 535/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 12:33:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:33:09.615406 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33603cc3-88ec-428f-a0ab-7a85fcdd3178 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:33:09.626184 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33603cc3-88ec-428f-a0ab-7a85fcdd3178 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:33:09.629844 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e87d5-6719-493c-9659-8ad29f682da5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645587202a91426c98f86abdcddce8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:33:09.630452 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e87d5-6719-493c-9659-8ad29f682da5 service neutron] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:09.630732 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e87d5-6719-493c-9659-8ad29f682da5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:09.631007 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e87d5-6719-493c-9659-8ad29f682da5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:09.640384 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56e87d5-6719-493c-9659-8ad29f682da5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:33:09.641841 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56e87d5-6719-493c-9659-8ad29f682da5 service neutron] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:33:09.651613 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 537/1072] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:33:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:33:11.910797 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48757e51-402c-465c-b771-9ad8e74dda77 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:11.911349 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48757e51-402c-465c-b771-9ad8e74dda77 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:11.911349 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48757e51-402c-465c-b771-9ad8e74dda77 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:11.912689 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 536/1073] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 12:33:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:33:11.917854 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350033a-df87-4726-bdd0-11278739a39e None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:11.918252 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350033a-df87-4726-bdd0-11278739a39e None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:11.918400 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350033a-df87-4726-bdd0-11278739a39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:11.936790 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-e350033a-df87-4726-bdd0-11278739a39e None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:33:11.938001 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-e350033a-df87-4726-bdd0-11278739a39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:33:11.945678 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 538/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 12:33:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:33:11.984342 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48757e51-402c-465c-b771-9ad8e74dda77 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:33:11.995714 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48757e51-402c-465c-b771-9ad8e74dda77 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:33:11.999134 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165819c5-bcb1-4c34-a527-5ae5776e0ebd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645587202a91426c98f86abdcddce8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:33:11.999731 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165819c5-bcb1-4c34-a527-5ae5776e0ebd service neutron] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:12.000013 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165819c5-bcb1-4c34-a527-5ae5776e0ebd service neutron] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:12.000289 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165819c5-bcb1-4c34-a527-5ae5776e0ebd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:12.005957 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=66 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:33:12.011006 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165819c5-bcb1-4c34-a527-5ae5776e0ebd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:33:12.012423 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165819c5-bcb1-4c34-a527-5ae5776e0ebd service neutron] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:33:12.021606 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 537/1075] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:33:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:33:14.262292 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35ce94-4eeb-41c8-a837-670377c23ebe None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:14.262816 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35ce94-4eeb-41c8-a837-670377c23ebe None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:14.262816 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35ce94-4eeb-41c8-a837-670377c23ebe None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:14.264178 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 539/1076] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 12:33:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:33:14.269258 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bfff0-f306-412a-8862-1457f89489fd None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:14.269715 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bfff0-f306-412a-8862-1457f89489fd None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:14.269847 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bfff0-f306-412a-8862-1457f89489fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:14.288690 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-a62bfff0-f306-412a-8862-1457f89489fd None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:33:14.289901 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-a62bfff0-f306-412a-8862-1457f89489fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:33:14.298171 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 538/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 12:33:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:33:14.337865 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35ce94-4eeb-41c8-a837-670377c23ebe None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:33:14.343127 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=73 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:33:14.349285 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35ce94-4eeb-41c8-a837-670377c23ebe None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:33:14.352699 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485b52c-b1b4-4bd5-abee-9561deeba779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645587202a91426c98f86abdcddce8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:33:14.353301 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485b52c-b1b4-4bd5-abee-9561deeba779 service neutron] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:14.353634 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485b52c-b1b4-4bd5-abee-9561deeba779 service neutron] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:14.353914 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485b52c-b1b4-4bd5-abee-9561deeba779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:14.362501 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3485b52c-b1b4-4bd5-abee-9561deeba779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:33:14.363918 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3485b52c-b1b4-4bd5-abee-9561deeba779 service neutron] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:33:14.373778 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 540/1078] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:33:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:33:16.618768 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc871d-3b8e-4b23-ade7-46928adacc0d None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:16.619347 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc871d-3b8e-4b23-ade7-46928adacc0d None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:16.619347 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc871d-3b8e-4b23-ade7-46928adacc0d None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:16.621930 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 539/1079] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 12:33:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:33:16.628376 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7d339-b272-4fe2-8b48-a0b07f27d4c9 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:16.628803 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7d339-b272-4fe2-8b48-a0b07f27d4c9 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:16.628938 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7d339-b272-4fe2-8b48-a0b07f27d4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:16.647681 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-6aa7d339-b272-4fe2-8b48-a0b07f27d4c9 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:33:16.648882 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-6aa7d339-b272-4fe2-8b48-a0b07f27d4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:33:16.657186 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 541/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 12:33:16 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:33:16.697789 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc871d-3b8e-4b23-ade7-46928adacc0d None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:33:16.708211 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc871d-3b8e-4b23-ade7-46928adacc0d None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:33:16.711650 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e441b-8a64-4aae-bd35-d873157682a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645587202a91426c98f86abdcddce8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:33:16.712239 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e441b-8a64-4aae-bd35-d873157682a6 service neutron] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:16.712515 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e441b-8a64-4aae-bd35-d873157682a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:16.712784 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e441b-8a64-4aae-bd35-d873157682a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:16.721857 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e441b-8a64-4aae-bd35-d873157682a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:33:16.723259 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e441b-8a64-4aae-bd35-d873157682a6 service neutron] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:33:16.732862 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 540/1081] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:33:16 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:33:18.965340 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817ccb7-30d2-4673-96b2-92fbcc51fef4 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:18.965945 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817ccb7-30d2-4673-96b2-92fbcc51fef4 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:18.965945 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817ccb7-30d2-4673-96b2-92fbcc51fef4 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:18.967259 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 542/1082] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 12:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:33:18.972385 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f5d2e-f6dd-4000-a5f5-2b38d7f58e37 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:18.972788 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f5d2e-f6dd-4000-a5f5-2b38d7f58e37 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:18.972938 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f5d2e-f6dd-4000-a5f5-2b38d7f58e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:18.992312 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-ad3f5d2e-f6dd-4000-a5f5-2b38d7f58e37 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:33:18.993493 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-ad3f5d2e-f6dd-4000-a5f5-2b38d7f58e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:33:19.001610 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 541/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 12:33:18 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:33:19.039264 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a817ccb7-30d2-4673-96b2-92fbcc51fef4 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:33:19.050355 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a817ccb7-30d2-4673-96b2-92fbcc51fef4 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:33:19.053741 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c5960-0378-4cb2-9588-83c0bfd07bfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645587202a91426c98f86abdcddce8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:33:19.054336 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c5960-0378-4cb2-9588-83c0bfd07bfd service neutron] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:19.054618 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c5960-0378-4cb2-9588-83c0bfd07bfd service neutron] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:19.054889 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c5960-0378-4cb2-9588-83c0bfd07bfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:19.063400 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c5960-0378-4cb2-9588-83c0bfd07bfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:33:19.064817 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c5960-0378-4cb2-9588-83c0bfd07bfd service neutron] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:33:19.074377 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 543/1084] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:33:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:33:21.286829 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413194c9-90b2-4083-9ba3-d31f9acb38f3 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:21.287395 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413194c9-90b2-4083-9ba3-d31f9acb38f3 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:21.287395 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413194c9-90b2-4083-9ba3-d31f9acb38f3 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:21.288706 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 542/1085] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 12:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:33:21.294506 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64034679-799d-4864-a218-12f307f7c28a None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:21.294905 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64034679-799d-4864-a218-12f307f7c28a None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:21.295063 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64034679-799d-4864-a218-12f307f7c28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:21.313963 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-64034679-799d-4864-a218-12f307f7c28a None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:33:21.315159 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-64034679-799d-4864-a218-12f307f7c28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:33:21.323395 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 544/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 12:33:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:33:21.360571 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413194c9-90b2-4083-9ba3-d31f9acb38f3 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:33:21.371287 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413194c9-90b2-4083-9ba3-d31f9acb38f3 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:33:21.374728 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e6c2b-b4dc-41dc-b0de-a20131be7902 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645587202a91426c98f86abdcddce8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:33:21.375353 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e6c2b-b4dc-41dc-b0de-a20131be7902 service neutron] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:21.375634 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e6c2b-b4dc-41dc-b0de-a20131be7902 service neutron] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:21.375907 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e6c2b-b4dc-41dc-b0de-a20131be7902 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:21.384570 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e6c2b-b4dc-41dc-b0de-a20131be7902 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:33:21.386521 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e6c2b-b4dc-41dc-b0de-a20131be7902 service neutron] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:33:21.395828 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 543/1087] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:33:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:33:31.309304 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=17 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:33:31.391716 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=21 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:33:44.913028 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267f1f3-754f-4187-a7cb-cc7f73c41fdc None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:44.913559 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267f1f3-754f-4187-a7cb-cc7f73c41fdc None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:44.913711 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267f1f3-754f-4187-a7cb-cc7f73c41fdc None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:44.914983 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 545/1088] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:33:44.920637 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c8c6d-437c-4746-bf9d-42dc09ffa633 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:44.921056 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c8c6d-437c-4746-bf9d-42dc09ffa633 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:44.921185 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c8c6d-437c-4746-bf9d-42dc09ffa633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:44.940318 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-c39c8c6d-437c-4746-bf9d-42dc09ffa633 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:33:44.941503 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-c39c8c6d-437c-4746-bf9d-42dc09ffa633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:33:44.949163 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 544/1089] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:33:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:33:44.998520 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd8411-bfad-4b91-a0c9-220359f6d462 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:44.998810 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd8411-bfad-4b91-a0c9-220359f6d462 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:44.999092 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd8411-bfad-4b91-a0c9-220359f6d462 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:45.000463 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 546/1090] 10.222.0.55 () {54 vars in 966 bytes} [Wed Jul 27 12:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:33:45.005702 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe9893-168c-4fc9-8ca4-e0117e983a4d None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:45.005996 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe9893-168c-4fc9-8ca4-e0117e983a4d None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:45.006280 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe9893-168c-4fc9-8ca4-e0117e983a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:45.025928 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-2bbe9893-168c-4fc9-8ca4-e0117e983a4d None None] MFA Rules not processed for user `a436eb33e8b040d192f1cfc9771fd351`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:33:45.027096 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-2bbe9893-168c-4fc9-8ca4-e0117e983a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:33:45.034614 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 545/1091] 10.222.0.55 () {58 vars in 1063 bytes} [Wed Jul 27 12:33:45 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:33:45.045276 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd8411-bfad-4b91-a0c9-220359f6d462 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:33:45.059861 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd8411-bfad-4b91-a0c9-220359f6d462 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:33:45.063691 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eace057-2a17-406a-84b3-2a63946c8c04 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a436eb33e8b040d192f1cfc9771fd351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:33:45.064296 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eace057-2a17-406a-84b3-2a63946c8c04 service glance] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:45.064582 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eace057-2a17-406a-84b3-2a63946c8c04 service glance] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:45.064862 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eace057-2a17-406a-84b3-2a63946c8c04 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:45.073554 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eace057-2a17-406a-84b3-2a63946c8c04 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:33:45.075011 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eace057-2a17-406a-84b3-2a63946c8c04 service glance] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:33:45.084570 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 547/1092] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:33:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:33:47.385035 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a141c-6d09-4f97-9f02-4396c7d4cc37 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:47.385683 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a141c-6d09-4f97-9f02-4396c7d4cc37 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:47.385683 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a141c-6d09-4f97-9f02-4396c7d4cc37 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:47.386956 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 546/1093] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:33:47.392000 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655ee99-d4f6-4ecd-ac8e-4c9206546097 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:47.392405 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655ee99-d4f6-4ecd-ac8e-4c9206546097 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:47.392568 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655ee99-d4f6-4ecd-ac8e-4c9206546097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:47.411769 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-6655ee99-d4f6-4ecd-ac8e-4c9206546097 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:33:47.412965 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-6655ee99-d4f6-4ecd-ac8e-4c9206546097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:33:47.421323 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 548/1094] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:33:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:33:47.444219 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a141c-6d09-4f97-9f02-4396c7d4cc37 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:33:47.456236 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a141c-6d09-4f97-9f02-4396c7d4cc37 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:33:47.460484 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a07db-af9f-4216-ab82-aab7b6fe12a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:33:47.461069 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a07db-af9f-4216-ab82-aab7b6fe12a6 admin admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:47.461350 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a07db-af9f-4216-ab82-aab7b6fe12a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:47.461641 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a07db-af9f-4216-ab82-aab7b6fe12a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:47.462853 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a07db-af9f-4216-ab82-aab7b6fe12a6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:33:47.464552 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: WARNING py.warnings [None req-e88a07db-af9f-4216-ab82-aab7b6fe12a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 12:33:47.464552 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: warnings.warn(msg) Jul 27 12:33:47.464552 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: Jul 27 12:33:47.465717 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a07db-af9f-4216-ab82-aab7b6fe12a6 admin admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:33:47.483753 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 547/1095] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Jul 27 12:33:47 2022] GET /identity/v3/projects => generated 1606 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 12:33:49.695849 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed40a1e-4241-4d96-a875-25f73106007c None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:49.696326 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed40a1e-4241-4d96-a875-25f73106007c None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:49.696513 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed40a1e-4241-4d96-a875-25f73106007c None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:49.698416 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 549/1096] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:33:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:33:49.703768 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769640eb-9101-4978-bc36-6295c7c71728 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:49.704161 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769640eb-9101-4978-bc36-6295c7c71728 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:49.704376 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769640eb-9101-4978-bc36-6295c7c71728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:49.723282 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-769640eb-9101-4978-bc36-6295c7c71728 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:33:49.724469 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-769640eb-9101-4978-bc36-6295c7c71728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:33:49.732333 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 548/1097] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:33:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:33:49.776927 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed40a1e-4241-4d96-a875-25f73106007c None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:33:49.790378 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed40a1e-4241-4d96-a875-25f73106007c None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:33:49.795328 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f618bab-f3e5-466e-ab0f-d34b1f1419ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36964c4644584d4282b04596ad20717c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:33:49.795934 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f618bab-f3e5-466e-ab0f-d34b1f1419ca service nova] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:49.796218 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f618bab-f3e5-466e-ab0f-d34b1f1419ca service nova] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:49.796498 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f618bab-f3e5-466e-ab0f-d34b1f1419ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:49.804518 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f618bab-f3e5-466e-ab0f-d34b1f1419ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:33:49.806621 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f618bab-f3e5-466e-ab0f-d34b1f1419ca service nova] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:33:49.815833 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 550/1098] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:33:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:33:52.178271 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223077ee-99a7-4017-92ae-cb8d7a892f52 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:52.178808 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223077ee-99a7-4017-92ae-cb8d7a892f52 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:52.178808 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223077ee-99a7-4017-92ae-cb8d7a892f52 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:52.180170 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 549/1099] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:33:52.185374 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20156e94-5100-4fab-aead-5478fe949c53 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:52.185832 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20156e94-5100-4fab-aead-5478fe949c53 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:52.185938 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20156e94-5100-4fab-aead-5478fe949c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:52.205155 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-20156e94-5100-4fab-aead-5478fe949c53 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:33:52.206382 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-20156e94-5100-4fab-aead-5478fe949c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:33:52.215059 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 551/1100] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:33:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:33:52.252020 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223077ee-99a7-4017-92ae-cb8d7a892f52 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:33:52.262945 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223077ee-99a7-4017-92ae-cb8d7a892f52 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:33:52.266410 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f19feb-5c76-42d3-990a-202d4e15515d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645587202a91426c98f86abdcddce8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:33:52.267006 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f19feb-5c76-42d3-990a-202d4e15515d service neutron] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:52.267286 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f19feb-5c76-42d3-990a-202d4e15515d service neutron] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:52.267560 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f19feb-5c76-42d3-990a-202d4e15515d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:52.276840 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f19feb-5c76-42d3-990a-202d4e15515d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:33:52.278289 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f19feb-5c76-42d3-990a-202d4e15515d service neutron] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:33:52.287398 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 550/1101] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:33:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:33:54.532138 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563ab3e-b783-494e-bf33-951a0986f76a None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:54.532560 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563ab3e-b783-494e-bf33-951a0986f76a None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:54.532671 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563ab3e-b783-494e-bf33-951a0986f76a None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:54.534068 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 552/1102] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:33:54.539331 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d548e7f-355b-4622-bcdb-3971df97de18 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:54.539728 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d548e7f-355b-4622-bcdb-3971df97de18 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:54.539891 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d548e7f-355b-4622-bcdb-3971df97de18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:54.558505 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-1d548e7f-355b-4622-bcdb-3971df97de18 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:33:54.559692 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-1d548e7f-355b-4622-bcdb-3971df97de18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:33:54.567325 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 551/1103] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:33:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:33:54.606170 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563ab3e-b783-494e-bf33-951a0986f76a None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:33:54.616697 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563ab3e-b783-494e-bf33-951a0986f76a None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:33:54.620483 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddba932-b5e6-44b1-8844-a45dd6d778ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645587202a91426c98f86abdcddce8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:33:54.621082 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddba932-b5e6-44b1-8844-a45dd6d778ba service neutron] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:54.621364 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddba932-b5e6-44b1-8844-a45dd6d778ba service neutron] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:54.621663 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddba932-b5e6-44b1-8844-a45dd6d778ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:54.630294 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddba932-b5e6-44b1-8844-a45dd6d778ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:33:54.631766 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddba932-b5e6-44b1-8844-a45dd6d778ba service neutron] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:33:54.641476 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 553/1104] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:33:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:33:56.952176 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0d5fd-4124-4181-ab7e-7c7e8946eae2 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:56.952674 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0d5fd-4124-4181-ab7e-7c7e8946eae2 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:56.952674 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0d5fd-4124-4181-ab7e-7c7e8946eae2 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:56.954057 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 552/1105] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:33:56.959280 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef54282-4f8d-4a73-b863-1899ac885ef7 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:56.959686 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef54282-4f8d-4a73-b863-1899ac885ef7 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:56.959869 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef54282-4f8d-4a73-b863-1899ac885ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:56.979234 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-1ef54282-4f8d-4a73-b863-1899ac885ef7 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:33:56.980426 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-1ef54282-4f8d-4a73-b863-1899ac885ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:33:56.988202 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 554/1106] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:33:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:33:57.032607 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0d5fd-4124-4181-ab7e-7c7e8946eae2 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:33:57.043115 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0d5fd-4124-4181-ab7e-7c7e8946eae2 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:33:57.046569 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df9da2-9813-4a23-95ee-f7e810554cf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645587202a91426c98f86abdcddce8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:33:57.047170 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df9da2-9813-4a23-95ee-f7e810554cf7 service neutron] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:57.047452 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df9da2-9813-4a23-95ee-f7e810554cf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:57.047727 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df9da2-9813-4a23-95ee-f7e810554cf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:57.056786 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df9da2-9813-4a23-95ee-f7e810554cf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:33:57.058248 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df9da2-9813-4a23-95ee-f7e810554cf7 service neutron] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:33:57.067346 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 553/1107] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:33:57 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:33:59.485273 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc6bdc-032e-46ab-8422-413ea8fb95af None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:59.485850 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc6bdc-032e-46ab-8422-413ea8fb95af None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:59.485850 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc6bdc-032e-46ab-8422-413ea8fb95af None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:59.487365 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 555/1108] 10.222.0.55 () {54 vars in 926 bytes} [Wed Jul 27 12:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:33:59.492425 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d3557-ca57-49e3-822e-b6ebd2a6e915 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:59.492841 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d3557-ca57-49e3-822e-b6ebd2a6e915 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:59.492979 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d3557-ca57-49e3-822e-b6ebd2a6e915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:59.511797 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-893d3557-ca57-49e3-822e-b6ebd2a6e915 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:33:59.512976 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-893d3557-ca57-49e3-822e-b6ebd2a6e915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:33:59.520499 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 554/1109] 10.222.0.55 () {58 vars in 1023 bytes} [Wed Jul 27 12:33:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:33:59.561514 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc6bdc-032e-46ab-8422-413ea8fb95af None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:33:59.572719 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc6bdc-032e-46ab-8422-413ea8fb95af None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:33:59.576230 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a988f32-0a37-412e-b038-d14f26d0bd9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645587202a91426c98f86abdcddce8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:33:59.576834 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a988f32-0a37-412e-b038-d14f26d0bd9b service neutron] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:33:59.577121 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a988f32-0a37-412e-b038-d14f26d0bd9b service neutron] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:33:59.577405 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a988f32-0a37-412e-b038-d14f26d0bd9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:33:59.586186 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a988f32-0a37-412e-b038-d14f26d0bd9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:33:59.587755 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a988f32-0a37-412e-b038-d14f26d0bd9b service neutron] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:33:59.596931 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 556/1110] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:33:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:34:09.507300 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=33 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:34:09.592920 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=33 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:35:51.326495 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b46e47-fc23-4641-81a6-84f5b2a6d9fc None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:35:51.327109 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b46e47-fc23-4641-81a6-84f5b2a6d9fc None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:35:51.327109 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b46e47-fc23-4641-81a6-84f5b2a6d9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:35:51.346367 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-e9b46e47-fc23-4641-81a6-84f5b2a6d9fc None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:35:51.347544 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-e9b46e47-fc23-4641-81a6-84f5b2a6d9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:35:51.355838 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 555/1111] 10.222.0.55 () {58 vars in 958 bytes} [Wed Jul 27 12:35:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:35:51.363827 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ce300-a47c-49b7-be29-d6094700cfc0 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:35:51.364348 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ce300-a47c-49b7-be29-d6094700cfc0 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:35:51.364449 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ce300-a47c-49b7-be29-d6094700cfc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:35:51.384002 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-438ce300-a47c-49b7-be29-d6094700cfc0 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:35:51.385184 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-438ce300-a47c-49b7-be29-d6094700cfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:35:51.392882 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 557/1112] 10.222.0.55 () {58 vars in 958 bytes} [Wed Jul 27 12:35:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:35:51.397234 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b46e47-fc23-4641-81a6-84f5b2a6d9fc None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:35:51.407277 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b46e47-fc23-4641-81a6-84f5b2a6d9fc None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:35:51.411715 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f4ae7-ab5e-4f4e-99cc-5baf71c283a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:35:51.412303 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f4ae7-ab5e-4f4e-99cc-5baf71c283a9 admin admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:35:51.412584 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f4ae7-ab5e-4f4e-99cc-5baf71c283a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:35:51.412856 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f4ae7-ab5e-4f4e-99cc-5baf71c283a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:35:51.413539 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f4ae7-ab5e-4f4e-99cc-5baf71c283a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:35:51.413878 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f4ae7-ab5e-4f4e-99cc-5baf71c283a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:35:51.415491 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: WARNING py.warnings [None req-d47f4ae7-ab5e-4f4e-99cc-5baf71c283a9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 12:35:51.415491 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: warnings.warn(msg) Jul 27 12:35:51.415491 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: Jul 27 12:35:51.416373 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f4ae7-ab5e-4f4e-99cc-5baf71c283a9 admin admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:35:51.427584 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 556/1113] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Jul 27 12:35:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:35:51.435757 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ce300-a47c-49b7-be29-d6094700cfc0 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:35:51.445467 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ce300-a47c-49b7-be29-d6094700cfc0 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:35:51.451943 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb8497-6121-4114-a95d-ab4a0c77071e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:35:51.452626 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb8497-6121-4114-a95d-ab4a0c77071e admin admin] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:35:51.452910 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb8497-6121-4114-a95d-ab4a0c77071e admin admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:35:51.453187 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb8497-6121-4114-a95d-ab4a0c77071e admin admin] PATH_INFO: `/v3/projects` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:35:51.454435 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb8497-6121-4114-a95d-ab4a0c77071e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:35:51.457145 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: WARNING py.warnings [None req-12fb8497-6121-4114-a95d-ab4a0c77071e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 12:35:51.457145 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: warnings.warn(msg) Jul 27 12:35:51.457145 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: Jul 27 12:35:51.458789 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb8497-6121-4114-a95d-ab4a0c77071e admin admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:35:51.489654 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 558/1114] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Jul 27 12:35:51 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 12:35:51.494178 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f4ae7-ab5e-4f4e-99cc-5baf71c283a9 admin admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:35:51.504078 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f4ae7-ab5e-4f4e-99cc-5baf71c283a9 admin admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:35:51.558484 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51237f32-6b96-4e34-99d5-4c6e6cee044a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:35:51.559081 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51237f32-6b96-4e34-99d5-4c6e6cee044a admin admin] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:35:51.559361 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51237f32-6b96-4e34-99d5-4c6e6cee044a admin admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:35:51.559634 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51237f32-6b96-4e34-99d5-4c6e6cee044a admin admin] PATH_INFO: `/v3/users` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:35:51.560293 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51237f32-6b96-4e34-99d5-4c6e6cee044a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:35:51.561282 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: WARNING py.warnings [None req-51237f32-6b96-4e34-99d5-4c6e6cee044a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 12:35:51.561282 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: warnings.warn(msg) Jul 27 12:35:51.561282 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: Jul 27 12:35:51.562509 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51237f32-6b96-4e34-99d5-4c6e6cee044a admin admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:35:51.583050 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 557/1115] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Jul 27 12:35:51 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 12:35:51.587639 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb8497-6121-4114-a95d-ab4a0c77071e admin admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:35:51.597734 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb8497-6121-4114-a95d-ab4a0c77071e admin admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:35:51.603005 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704f8bf-784b-4cb1-9fab-3307ade48f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:35:51.603616 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704f8bf-784b-4cb1-9fab-3307ade48f4c admin admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:35:51.603902 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704f8bf-784b-4cb1-9fab-3307ade48f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:35:51.604180 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704f8bf-784b-4cb1-9fab-3307ade48f4c admin admin] PATH_INFO: `/v3/roles` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:35:51.604884 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704f8bf-784b-4cb1-9fab-3307ade48f4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:35:51.605914 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: WARNING py.warnings [None req-f704f8bf-784b-4cb1-9fab-3307ade48f4c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 12:35:51.605914 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: warnings.warn(msg) Jul 27 12:35:51.605914 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: Jul 27 12:35:51.606787 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704f8bf-784b-4cb1-9fab-3307ade48f4c admin admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:35:51.619337 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 559/1116] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Jul 27 12:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 12:35:51.623348 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51237f32-6b96-4e34-99d5-4c6e6cee044a admin admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:35:51.633190 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51237f32-6b96-4e34-99d5-4c6e6cee044a admin admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:35:51.638222 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e17eb1-6fda-4802-ba04-448d998f3237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:35:51.638861 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e17eb1-6fda-4802-ba04-448d998f3237 admin admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:35:51.639127 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e17eb1-6fda-4802-ba04-448d998f3237 admin admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:35:51.639400 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e17eb1-6fda-4802-ba04-448d998f3237 admin admin] PATH_INFO: `/v3/roles` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:35:51.640082 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e17eb1-6fda-4802-ba04-448d998f3237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:35:51.641067 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: WARNING py.warnings [None req-78e17eb1-6fda-4802-ba04-448d998f3237 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 12:35:51.641067 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: warnings.warn(msg) Jul 27 12:35:51.641067 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: Jul 27 12:35:51.641972 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e17eb1-6fda-4802-ba04-448d998f3237 admin admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:35:51.656365 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 558/1117] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Jul 27 12:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 12:35:51.660459 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704f8bf-784b-4cb1-9fab-3307ade48f4c admin admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:35:51.671521 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704f8bf-784b-4cb1-9fab-3307ade48f4c admin admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:35:51.676230 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f0574-6d6e-4776-99bb-7c5a240307c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:35:51.676898 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f0574-6d6e-4776-99bb-7c5a240307c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:35:51.677180 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f0574-6d6e-4776-99bb-7c5a240307c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:35:51.677458 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f0574-6d6e-4776-99bb-7c5a240307c8 admin admin] PATH_INFO: `/v3/projects/18c14cf7e5b44476a9f04af4d36e862b/users/572a59e3862e4169bf6212b6085577cf/roles/2136377433854360927c578b39f16e6f` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:35:51.692405 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f0574-6d6e-4776-99bb-7c5a240307c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18c14cf7e5b44476a9f04af4d36e862b, user_id=572a59e3862e4169bf6212b6085577cf, role_id=2136377433854360927c578b39f16e6f)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:35:51.693474 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: WARNING py.warnings [None req-8c3f0574-6d6e-4776-99bb-7c5a240307c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 12:35:51.693474 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: warnings.warn(msg) Jul 27 12:35:51.693474 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: Jul 27 12:35:51.696356 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f0574-6d6e-4776-99bb-7c5a240307c8 admin admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:35:51.709502 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 560/1118] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Jul 27 12:35:51 2022] PUT /identity/v3/projects/18c14cf7e5b44476a9f04af4d36e862b/users/572a59e3862e4169bf6212b6085577cf/roles/2136377433854360927c578b39f16e6f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 12:35:51.722217 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04101a1-5565-456d-a17e-1cf7863c94f6 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:35:51.722502 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04101a1-5565-456d-a17e-1cf7863c94f6 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:35:51.722783 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04101a1-5565-456d-a17e-1cf7863c94f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:35:51.874135 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-f04101a1-5565-456d-a17e-1cf7863c94f6 None None] MFA Rules not processed for user `572a59e3862e4169bf6212b6085577cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:35:51.875252 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-f04101a1-5565-456d-a17e-1cf7863c94f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:35:51.935629 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 559/1119] 10.222.0.55 () {58 vars in 958 bytes} [Wed Jul 27 12:35:51 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:35:51.949268 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719b3e8-46b1-4e6b-8123-91a22f6a709a None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:35:51.949556 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719b3e8-46b1-4e6b-8123-91a22f6a709a None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:35:51.949878 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719b3e8-46b1-4e6b-8123-91a22f6a709a None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:35:51.951220 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 561/1120] 10.222.0.55 () {54 vars in 964 bytes} [Wed Jul 27 12:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:35:51.956106 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9c836-42a9-40db-a120-90ce5ec32daa None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:35:51.956392 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9c836-42a9-40db-a120-90ce5ec32daa None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:35:51.956669 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9c836-42a9-40db-a120-90ce5ec32daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:35:51.976112 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-16a9c836-42a9-40db-a120-90ce5ec32daa None None] MFA Rules not processed for user `e6ead01964e14f389bcfca4e9d9b6475`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:35:51.977298 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-16a9c836-42a9-40db-a120-90ce5ec32daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:35:52.020437 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:35:52.029540 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 560/1121] 10.222.0.55 () {58 vars in 1061 bytes} [Wed Jul 27 12:35:51 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:35:52.037135 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719b3e8-46b1-4e6b-8123-91a22f6a709a None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:35:52.052311 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719b3e8-46b1-4e6b-8123-91a22f6a709a None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:35:52.056336 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf51005-d4ee-4cf2-89ab-756af195d999 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ead01964e14f389bcfca4e9d9b6475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:35:52.056934 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf51005-d4ee-4cf2-89ab-756af195d999 service cinder] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:35:52.057220 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf51005-d4ee-4cf2-89ab-756af195d999 service cinder] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:35:52.057500 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf51005-d4ee-4cf2-89ab-756af195d999 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:35:52.065588 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf51005-d4ee-4cf2-89ab-756af195d999 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:35:52.067039 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf51005-d4ee-4cf2-89ab-756af195d999 service cinder] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:35:52.076257 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 562/1122] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:35:52 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:35:52.115440 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e61cf-92f9-4180-b735-07e93b952fa1 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:35:52.115726 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e61cf-92f9-4180-b735-07e93b952fa1 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:35:52.116007 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e61cf-92f9-4180-b735-07e93b952fa1 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:35:52.117811 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 561/1123] 10.222.0.55 () {52 vars in 830 bytes} [Wed Jul 27 12:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:35:52.121541 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf51005-d4ee-4cf2-89ab-756af195d999 service cinder] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:35:52.182920 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf51005-d4ee-4cf2-89ab-756af195d999 service cinder] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:35:52.187415 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd795558-cfb2-4820-bf58-d11e9fe0c5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:35:52.188057 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd795558-cfb2-4820-bf58-d11e9fe0c5ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:35:52.188339 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd795558-cfb2-4820-bf58-d11e9fe0c5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:35:52.188614 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd795558-cfb2-4820-bf58-d11e9fe0c5ba admin admin] PATH_INFO: `/v3/users/572a59e3862e4169bf6212b6085577cf` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:35:52.189823 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd795558-cfb2-4820-bf58-d11e9fe0c5ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=572a59e3862e4169bf6212b6085577cf)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:35:52.190841 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: WARNING py.warnings [None req-bd795558-cfb2-4820-bf58-d11e9fe0c5ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 12:35:52.190841 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: warnings.warn(msg) Jul 27 12:35:52.190841 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: Jul 27 12:35:52.192049 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd795558-cfb2-4820-bf58-d11e9fe0c5ba admin admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:35:52.255484 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [None req-bd795558-cfb2-4820-bf58-d11e9fe0c5ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '572a59e3862e4169bf6212b6085577cf'} {{(pid=87917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:35:52.273864 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [None req-bd795558-cfb2-4820-bf58-d11e9fe0c5ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '572a59e3862e4169bf6212b6085577cf'} {{(pid=87917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:35:52.274671 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [None req-bd795558-cfb2-4820-bf58-d11e9fe0c5ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '572a59e3862e4169bf6212b6085577cf'} {{(pid=87917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:35:52.284050 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [None req-bd795558-cfb2-4820-bf58-d11e9fe0c5ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '572a59e3862e4169bf6212b6085577cf'} {{(pid=87917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:35:52.296223 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [None req-bd795558-cfb2-4820-bf58-d11e9fe0c5ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '572a59e3862e4169bf6212b6085577cf'} {{(pid=87917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:35:52.302061 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 563/1124] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Jul 27 12:35:52 2022] DELETE /identity/v3/users/572a59e3862e4169bf6212b6085577cf => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 12:35:52.307084 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4413c33-a5c9-4233-82ab-95f440ba010d None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:35:52.307377 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4413c33-a5c9-4233-82ab-95f440ba010d None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:35:52.307689 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4413c33-a5c9-4233-82ab-95f440ba010d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:35:52.330560 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-b4413c33-a5c9-4233-82ab-95f440ba010d None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:35:52.331843 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-b4413c33-a5c9-4233-82ab-95f440ba010d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:35:52.390216 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 562/1125] 10.222.0.55 () {58 vars in 958 bytes} [Wed Jul 27 12:35:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:35:52.399689 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd795558-cfb2-4820-bf58-d11e9fe0c5ba admin admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:35:52.401107 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-bd795558-cfb2-4820-bf58-d11e9fe0c5ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:35:52.406346 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:35:52.459774 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd795558-cfb2-4820-bf58-d11e9fe0c5ba admin admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:35:52.463319 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca88d75-b1cf-4623-a35b-f6679ef14045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645587202a91426c98f86abdcddce8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:35:52.463934 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca88d75-b1cf-4623-a35b-f6679ef14045 service neutron] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:35:52.464220 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca88d75-b1cf-4623-a35b-f6679ef14045 service neutron] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:35:52.464498 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca88d75-b1cf-4623-a35b-f6679ef14045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:35:52.473252 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca88d75-b1cf-4623-a35b-f6679ef14045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:35:52.474723 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca88d75-b1cf-4623-a35b-f6679ef14045 service neutron] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:35:52.484522 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 564/1126] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:35:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:35:52.938450 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4413c33-a5c9-4233-82ab-95f440ba010d None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:35:52.940002 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-b4413c33-a5c9-4233-82ab-95f440ba010d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:35:52.953916 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4413c33-a5c9-4233-82ab-95f440ba010d None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:35:52.959621 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2130708a-f610-40dd-a845-609cb6706674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:35:52.960278 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130708a-f610-40dd-a845-609cb6706674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:35:52.960557 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130708a-f610-40dd-a845-609cb6706674 admin admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:35:52.960834 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130708a-f610-40dd-a845-609cb6706674 admin admin] PATH_INFO: `/v3/projects/18c14cf7e5b44476a9f04af4d36e862b` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:35:52.962065 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2130708a-f610-40dd-a845-609cb6706674 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18c14cf7e5b44476a9f04af4d36e862b)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:35:52.963084 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: WARNING py.warnings [None req-2130708a-f610-40dd-a845-609cb6706674 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 12:35:52.963084 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: warnings.warn(msg) Jul 27 12:35:52.963084 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: Jul 27 12:35:52.964284 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2130708a-f610-40dd-a845-609cb6706674 admin admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:35:53.026108 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [None req-2130708a-f610-40dd-a845-609cb6706674 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18c14cf7e5b44476a9f04af4d36e862b', 'request_id': 'req-2130708a-f610-40dd-a845-609cb6706674'} {{(pid=87918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:35:53.038949 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [None req-2130708a-f610-40dd-a845-609cb6706674 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18c14cf7e5b44476a9f04af4d36e862b', 'request_id': 'req-2130708a-f610-40dd-a845-609cb6706674'} {{(pid=87918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:35:53.044906 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [None req-2130708a-f610-40dd-a845-609cb6706674 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18c14cf7e5b44476a9f04af4d36e862b', 'request_id': 'req-2130708a-f610-40dd-a845-609cb6706674'} {{(pid=87918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:35:53.059316 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [None req-2130708a-f610-40dd-a845-609cb6706674 admin admin] The token cache is being invalidate because project 18c14cf7e5b44476a9f04af4d36e862b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87918) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 12:35:53.059605 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [None req-2130708a-f610-40dd-a845-609cb6706674 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:35:53.060249 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [None req-2130708a-f610-40dd-a845-609cb6706674 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:35:53.061870 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 563/1127] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Jul 27 12:35:52 2022] DELETE /identity/v3/projects/18c14cf7e5b44476a9f04af4d36e862b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 12:36:02.480364 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=25 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:36:03.056143 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:37:16.638231 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6b9d9-7ee6-43da-bc94-ee193780046a None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:37:16.638686 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6b9d9-7ee6-43da-bc94-ee193780046a None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:37:16.638853 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6b9d9-7ee6-43da-bc94-ee193780046a None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:37:16.640304 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 565/1128] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 12:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:37:16.645035 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab3681-050c-4c9f-a131-56af385e9cd5 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:37:16.645486 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab3681-050c-4c9f-a131-56af385e9cd5 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:37:16.645621 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab3681-050c-4c9f-a131-56af385e9cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:37:16.715469 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-f2ab3681-050c-4c9f-a131-56af385e9cd5 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:37:16.716658 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-f2ab3681-050c-4c9f-a131-56af385e9cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:37:16.808682 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 564/1129] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 12:37:16 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:37:16.970546 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6b9d9-7ee6-43da-bc94-ee193780046a None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:37:16.972268 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-12d6b9d9-7ee6-43da-bc94-ee193780046a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:37:17.058726 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6b9d9-7ee6-43da-bc94-ee193780046a None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:37:17.063740 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594acf5-1a9d-42da-a502-6ba20d9df9bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36964c4644584d4282b04596ad20717c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:37:17.064349 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594acf5-1a9d-42da-a502-6ba20d9df9bd service nova] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:37:17.064633 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594acf5-1a9d-42da-a502-6ba20d9df9bd service nova] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:37:17.064908 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594acf5-1a9d-42da-a502-6ba20d9df9bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:37:17.073545 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a594acf5-1a9d-42da-a502-6ba20d9df9bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:37:17.075150 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a594acf5-1a9d-42da-a502-6ba20d9df9bd service nova] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:37:17.084812 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 566/1130] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:37:16 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:37:17.927525 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbb7fc-9f03-4e16-94af-bfef92f9f083 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:37:17.928096 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbb7fc-9f03-4e16-94af-bfef92f9f083 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:37:17.928096 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbb7fc-9f03-4e16-94af-bfef92f9f083 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:37:17.930326 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 565/1131] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 12:37:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:37:17.935203 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e70a2a-0a0e-4bfe-9fdb-beba3bcda91d None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:37:17.935608 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e70a2a-0a0e-4bfe-9fdb-beba3bcda91d None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:37:17.935758 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e70a2a-0a0e-4bfe-9fdb-beba3bcda91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:37:17.957710 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-d1e70a2a-0a0e-4bfe-9fdb-beba3bcda91d None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:37:17.958848 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-d1e70a2a-0a0e-4bfe-9fdb-beba3bcda91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:37:17.968162 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 567/1132] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 12:37:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:37:18.120324 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdbb7fc-9f03-4e16-94af-bfef92f9f083 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:37:18.134247 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdbb7fc-9f03-4e16-94af-bfef92f9f083 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:37:18.139063 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ba959-7493-4334-a442-f8ca716b1bab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36964c4644584d4282b04596ad20717c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:37:18.139687 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ba959-7493-4334-a442-f8ca716b1bab service nova] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:37:18.140022 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ba959-7493-4334-a442-f8ca716b1bab service nova] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:37:18.140439 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ba959-7493-4334-a442-f8ca716b1bab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:37:18.149061 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ba959-7493-4334-a442-f8ca716b1bab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:37:18.150676 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ba959-7493-4334-a442-f8ca716b1bab service nova] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:37:18.159985 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 566/1133] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:37:18 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:37:22.841766 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c5e65-de43-41ea-9c85-505f383de21d None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:37:22.842305 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c5e65-de43-41ea-9c85-505f383de21d None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:37:22.842305 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c5e65-de43-41ea-9c85-505f383de21d None None] PATH_INFO: `/v3` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:37:22.843613 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 568/1134] 10.222.0.43 () {54 vars in 925 bytes} [Wed Jul 27 12:37:22 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 12:37:22.849574 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3237c-070b-4ef2-9837-b80a669d19e4 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:37:22.850033 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3237c-070b-4ef2-9837-b80a669d19e4 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:37:22.850143 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3237c-070b-4ef2-9837-b80a669d19e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:37:22.879822 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-a0e3237c-070b-4ef2-9837-b80a669d19e4 None None] MFA Rules not processed for user `6cc3f626dcb5495c9eed35a8e50092e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:37:22.881019 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-a0e3237c-070b-4ef2-9837-b80a669d19e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:37:22.937171 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:37:22.946332 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 567/1135] 10.222.0.43 () {58 vars in 1015 bytes} [Wed Jul 27 12:37:22 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:37:26.979955 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9fc6e-a28c-4520-817c-feb173b50367 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:37:26.980460 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9fc6e-a28c-4520-817c-feb173b50367 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:37:26.980460 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9fc6e-a28c-4520-817c-feb173b50367 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:37:26.981767 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 569/1136] 10.222.0.55 () {54 vars in 961 bytes} [Wed Jul 27 12:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:37:26.986770 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f9df8-44b4-4de6-92d4-19902842d3ba None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:37:26.987163 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f9df8-44b4-4de6-92d4-19902842d3ba None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:37:26.987344 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f9df8-44b4-4de6-92d4-19902842d3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:37:27.006150 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-369f9df8-44b4-4de6-92d4-19902842d3ba None None] MFA Rules not processed for user `6cc3f626dcb5495c9eed35a8e50092e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:37:27.007323 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-369f9df8-44b4-4de6-92d4-19902842d3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:37:27.016028 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 568/1137] 10.222.0.55 () {58 vars in 1058 bytes} [Wed Jul 27 12:37:26 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:37:27.023055 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9fc6e-a28c-4520-817c-feb173b50367 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:37:27.036728 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9fc6e-a28c-4520-817c-feb173b50367 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:37:27.041519 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b1d241-9203-4fae-b4bd-f09f8b2cf30a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc3f626dcb5495c9eed35a8e50092e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:37:27.042142 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1d241-9203-4fae-b4bd-f09f8b2cf30a service placement] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:37:27.042418 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1d241-9203-4fae-b4bd-f09f8b2cf30a service placement] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:37:27.042687 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1d241-9203-4fae-b4bd-f09f8b2cf30a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:37:27.050737 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b1d241-9203-4fae-b4bd-f09f8b2cf30a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:37:27.052288 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b1d241-9203-4fae-b4bd-f09f8b2cf30a service placement] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:37:27.061547 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 570/1138] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:37:27 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:37:29.402967 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c07fa9-59ef-4f40-a2cc-d8dfb84d7c3e None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:37:29.403523 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c07fa9-59ef-4f40-a2cc-d8dfb84d7c3e None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:37:29.403523 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c07fa9-59ef-4f40-a2cc-d8dfb84d7c3e None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:37:29.404899 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 569/1139] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 12:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:37:29.409539 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a4328-1e16-4a82-934a-1b1995c48fa5 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:37:29.409959 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a4328-1e16-4a82-934a-1b1995c48fa5 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:37:29.410114 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a4328-1e16-4a82-934a-1b1995c48fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:37:29.428948 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-430a4328-1e16-4a82-934a-1b1995c48fa5 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:37:29.430115 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-430a4328-1e16-4a82-934a-1b1995c48fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:37:29.437887 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 571/1140] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 12:37:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:37:29.593855 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c07fa9-59ef-4f40-a2cc-d8dfb84d7c3e None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:37:29.607736 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c07fa9-59ef-4f40-a2cc-d8dfb84d7c3e None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:37:29.612594 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1717a-ad6a-4335-9bbc-4270e28fcfdf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36964c4644584d4282b04596ad20717c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:37:29.613195 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1717a-ad6a-4335-9bbc-4270e28fcfdf service nova] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:37:29.613477 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1717a-ad6a-4335-9bbc-4270e28fcfdf service nova] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:37:29.613783 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1717a-ad6a-4335-9bbc-4270e28fcfdf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:37:29.622495 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1717a-ad6a-4335-9bbc-4270e28fcfdf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:37:29.624071 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1717a-ad6a-4335-9bbc-4270e28fcfdf service nova] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:37:29.633839 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 570/1141] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:37:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:37:30.450509 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229da3b-0864-456d-8451-73425c8cd27e None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:37:30.451050 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229da3b-0864-456d-8451-73425c8cd27e None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:37:30.451050 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229da3b-0864-456d-8451-73425c8cd27e None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:37:30.452400 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 572/1142] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 12:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:37:30.457477 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f042f-433c-48bb-b792-fdce07e662fa None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:37:30.457939 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f042f-433c-48bb-b792-fdce07e662fa None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:37:30.458078 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f042f-433c-48bb-b792-fdce07e662fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:37:30.478973 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-d76f042f-433c-48bb-b792-fdce07e662fa None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:37:30.480172 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-d76f042f-433c-48bb-b792-fdce07e662fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:37:30.488031 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 571/1143] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 12:37:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:37:30.646496 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229da3b-0864-456d-8451-73425c8cd27e None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:37:30.660539 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229da3b-0864-456d-8451-73425c8cd27e None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:37:30.665599 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6850f6-9b0e-4656-891e-d39bc51baa67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36964c4644584d4282b04596ad20717c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:37:30.666229 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6850f6-9b0e-4656-891e-d39bc51baa67 service nova] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:37:30.666507 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6850f6-9b0e-4656-891e-d39bc51baa67 service nova] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:37:30.666781 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6850f6-9b0e-4656-891e-d39bc51baa67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:37:30.675040 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6850f6-9b0e-4656-891e-d39bc51baa67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:37:30.676611 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6850f6-9b0e-4656-891e-d39bc51baa67 service nova] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:37:30.685788 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 573/1144] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:37:30 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:37:34.796918 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b2f39-6559-49f7-b87e-43afaa0ac285 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:37:34.797532 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b2f39-6559-49f7-b87e-43afaa0ac285 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:37:34.797532 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b2f39-6559-49f7-b87e-43afaa0ac285 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:37:34.798858 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 572/1145] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 12:37:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:37:34.804086 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c28c77-21db-492f-b537-c864ca57f03f None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:37:34.804554 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c28c77-21db-492f-b537-c864ca57f03f None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:37:34.804661 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c28c77-21db-492f-b537-c864ca57f03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:37:34.823377 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-70c28c77-21db-492f-b537-c864ca57f03f None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:37:34.824559 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-70c28c77-21db-492f-b537-c864ca57f03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:37:34.832114 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 574/1146] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 12:37:34 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:37:34.869554 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b2f39-6559-49f7-b87e-43afaa0ac285 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:37:34.871511 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-313b2f39-6559-49f7-b87e-43afaa0ac285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:37:34.928357 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b2f39-6559-49f7-b87e-43afaa0ac285 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:37:34.931835 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33cac1-dbb5-459e-bb04-3612a90f9ea2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645587202a91426c98f86abdcddce8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:37:34.932444 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33cac1-dbb5-459e-bb04-3612a90f9ea2 service neutron] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:37:34.932730 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33cac1-dbb5-459e-bb04-3612a90f9ea2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:37:34.933010 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33cac1-dbb5-459e-bb04-3612a90f9ea2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:37:34.942218 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e33cac1-dbb5-459e-bb04-3612a90f9ea2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:37:34.943673 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e33cac1-dbb5-459e-bb04-3612a90f9ea2 service neutron] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:37:34.953064 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 573/1147] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:37:34 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:37:37.132780 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90062ba8-dbbc-46f0-aa2a-d261f7045c5a None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:37:37.133991 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90062ba8-dbbc-46f0-aa2a-d261f7045c5a None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:37:37.133991 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90062ba8-dbbc-46f0-aa2a-d261f7045c5a None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:37:37.135250 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 575/1148] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 12:37:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:37:37.140409 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75a04d-a0be-4437-95cb-c4518d30f489 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:37:37.140919 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75a04d-a0be-4437-95cb-c4518d30f489 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:37:37.141058 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75a04d-a0be-4437-95cb-c4518d30f489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:37:37.161369 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-dd75a04d-a0be-4437-95cb-c4518d30f489 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:37:37.162596 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-dd75a04d-a0be-4437-95cb-c4518d30f489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:37:37.170300 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 574/1149] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 12:37:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:37:37.208761 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90062ba8-dbbc-46f0-aa2a-d261f7045c5a None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:37:37.210537 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-90062ba8-dbbc-46f0-aa2a-d261f7045c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:37:37.223635 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90062ba8-dbbc-46f0-aa2a-d261f7045c5a None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:37:37.227182 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad6c306-ce17-4a8d-9aac-bb3471a71c41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645587202a91426c98f86abdcddce8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:37:37.227790 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6c306-ce17-4a8d-9aac-bb3471a71c41 service neutron] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:37:37.228075 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6c306-ce17-4a8d-9aac-bb3471a71c41 service neutron] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:37:37.228353 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6c306-ce17-4a8d-9aac-bb3471a71c41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:37:37.237158 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad6c306-ce17-4a8d-9aac-bb3471a71c41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:37:37.238615 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad6c306-ce17-4a8d-9aac-bb3471a71c41 service neutron] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:37:37.248892 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 576/1150] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:37:37 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:37:40.989911 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90748678-ac01-4823-827e-3a5c75254506 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:37:40.990463 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90748678-ac01-4823-827e-3a5c75254506 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:37:40.990463 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90748678-ac01-4823-827e-3a5c75254506 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:37:40.991746 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 575/1151] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 12:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:37:40.997377 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542647f-9889-40b5-8e94-1b15cfbdca16 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:37:40.997816 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542647f-9889-40b5-8e94-1b15cfbdca16 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:37:40.997979 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542647f-9889-40b5-8e94-1b15cfbdca16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:37:41.017232 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-d542647f-9889-40b5-8e94-1b15cfbdca16 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:37:41.018451 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-d542647f-9889-40b5-8e94-1b15cfbdca16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:37:41.026903 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 577/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 12:37:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:37:41.302861 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90748678-ac01-4823-827e-3a5c75254506 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:37:41.304508 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-90748678-ac01-4823-827e-3a5c75254506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:37:41.359931 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90748678-ac01-4823-827e-3a5c75254506 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:37:41.363491 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5116ed3-1a2b-4fcf-8c11-68206804dc7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ead01964e14f389bcfca4e9d9b6475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:37:41.364084 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5116ed3-1a2b-4fcf-8c11-68206804dc7a service cinder] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:37:41.364360 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5116ed3-1a2b-4fcf-8c11-68206804dc7a service cinder] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:37:41.364630 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5116ed3-1a2b-4fcf-8c11-68206804dc7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:37:41.373487 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5116ed3-1a2b-4fcf-8c11-68206804dc7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:37:41.374939 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5116ed3-1a2b-4fcf-8c11-68206804dc7a service cinder] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:37:41.384714 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 576/1153] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:37:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:37:43.635721 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950ab07-e792-4b82-bc58-74f9df553e42 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:37:43.636363 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950ab07-e792-4b82-bc58-74f9df553e42 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:37:43.636363 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950ab07-e792-4b82-bc58-74f9df553e42 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:37:43.637664 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 578/1154] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 12:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:37:43.642717 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d4226-0639-458a-be60-ebe2fad13341 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:37:43.643149 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d4226-0639-458a-be60-ebe2fad13341 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:37:43.643253 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d4226-0639-458a-be60-ebe2fad13341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:37:43.662829 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-c34d4226-0639-458a-be60-ebe2fad13341 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:37:43.664048 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-c34d4226-0639-458a-be60-ebe2fad13341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:37:43.671930 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 577/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 12:37:43 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:37:43.943838 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950ab07-e792-4b82-bc58-74f9df553e42 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:37:43.945539 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-a950ab07-e792-4b82-bc58-74f9df553e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:37:43.953050 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=70 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:37:43.959452 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950ab07-e792-4b82-bc58-74f9df553e42 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:37:43.963422 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5071f32-d023-4cb0-809d-0b213fe22584 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6ead01964e14f389bcfca4e9d9b6475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:37:43.964020 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5071f32-d023-4cb0-809d-0b213fe22584 service cinder] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:37:43.964300 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5071f32-d023-4cb0-809d-0b213fe22584 service cinder] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:37:43.964574 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5071f32-d023-4cb0-809d-0b213fe22584 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:37:43.973260 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5071f32-d023-4cb0-809d-0b213fe22584 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:37:43.974717 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5071f32-d023-4cb0-809d-0b213fe22584 service cinder] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:37:43.984466 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 579/1156] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:37:43 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:37:53.658283 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=70 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:37:53.980502 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=5 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:39:02.163335 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24940ccd-dcc6-400d-8c99-466eff4943d6 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:02.163978 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24940ccd-dcc6-400d-8c99-466eff4943d6 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:02.163978 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24940ccd-dcc6-400d-8c99-466eff4943d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:02.164177 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cc524-e160-45e0-b51b-cf864fabb534 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:02.164579 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cc524-e160-45e0-b51b-cf864fabb534 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:02.164683 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cc524-e160-45e0-b51b-cf864fabb534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:02.183711 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-a86cc524-e160-45e0-b51b-cf864fabb534 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:39:02.183930 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-24940ccd-dcc6-400d-8c99-466eff4943d6 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:39:02.190791 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-24940ccd-dcc6-400d-8c99-466eff4943d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:39:02.190949 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-a86cc524-e160-45e0-b51b-cf864fabb534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:39:02.198592 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 580/1157] 10.222.0.55 () {58 vars in 958 bytes} [Wed Jul 27 12:39:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 12:39:02.199034 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 578/1158] 10.222.0.55 () {58 vars in 958 bytes} [Wed Jul 27 12:39:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:39:02.206611 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c092b-ead6-4484-9539-e871bcf0deab None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:02.206858 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e98380-802e-4bc0-8d66-92ed33522893 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:02.206981 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c092b-ead6-4484-9539-e871bcf0deab None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:02.207075 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e98380-802e-4bc0-8d66-92ed33522893 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:02.207173 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c092b-ead6-4484-9539-e871bcf0deab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:02.207340 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e98380-802e-4bc0-8d66-92ed33522893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:02.226556 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-8d1c092b-ead6-4484-9539-e871bcf0deab None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:39:02.227751 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-8d1c092b-ead6-4484-9539-e871bcf0deab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:39:02.228129 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-52e98380-802e-4bc0-8d66-92ed33522893 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:39:02.229281 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-52e98380-802e-4bc0-8d66-92ed33522893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:39:02.236824 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 581/1159] 10.222.0.55 () {58 vars in 958 bytes} [Wed Jul 27 12:39:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 12:39:02.237189 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 579/1160] 10.222.0.55 () {58 vars in 958 bytes} [Wed Jul 27 12:39:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 12:39:02.242500 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c092b-ead6-4484-9539-e871bcf0deab None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:39:02.242670 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e98380-802e-4bc0-8d66-92ed33522893 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:39:02.251981 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e98380-802e-4bc0-8d66-92ed33522893 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:39:02.252447 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c092b-ead6-4484-9539-e871bcf0deab None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:39:02.256555 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ee172-ff56-43fb-a365-7cfff6264de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:39:02.256974 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207abf8a-9cc0-4beb-ae20-a81cbc0e67fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:39:02.257150 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ee172-ff56-43fb-a365-7cfff6264de9 admin admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:02.257429 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ee172-ff56-43fb-a365-7cfff6264de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:02.257572 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207abf8a-9cc0-4beb-ae20-a81cbc0e67fa admin admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:02.257743 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ee172-ff56-43fb-a365-7cfff6264de9 admin admin] PATH_INFO: `/v3/domains` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:02.257890 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207abf8a-9cc0-4beb-ae20-a81cbc0e67fa admin admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:02.258171 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207abf8a-9cc0-4beb-ae20-a81cbc0e67fa admin admin] PATH_INFO: `/v3/domains` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:02.258430 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ee172-ff56-43fb-a365-7cfff6264de9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87918) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:39:02.258732 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ee172-ff56-43fb-a365-7cfff6264de9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:39:02.258861 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207abf8a-9cc0-4beb-ae20-a81cbc0e67fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87917) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 12:39:02.259166 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207abf8a-9cc0-4beb-ae20-a81cbc0e67fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:39:02.260171 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: WARNING py.warnings [None req-207abf8a-9cc0-4beb-ae20-a81cbc0e67fa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 12:39:02.260171 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: warnings.warn(msg) Jul 27 12:39:02.260171 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: Jul 27 12:39:02.260444 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ee172-ff56-43fb-a365-7cfff6264de9 admin admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:39:02.261042 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207abf8a-9cc0-4beb-ae20-a81cbc0e67fa admin admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:39:02.271836 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 580/1161] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Jul 27 12:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:39:02.273632 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 582/1162] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Jul 27 12:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 12:39:02.279648 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ee172-ff56-43fb-a365-7cfff6264de9 admin admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:39:02.279960 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207abf8a-9cc0-4beb-ae20-a81cbc0e67fa admin admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:39:02.290028 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ee172-ff56-43fb-a365-7cfff6264de9 admin admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:39:02.290182 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207abf8a-9cc0-4beb-ae20-a81cbc0e67fa admin admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:39:02.294493 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad46b2-bd3a-4b42-8441-bd27334e42b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:39:02.294657 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437ca66-b8be-49d4-97da-18643571b8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:39:02.295114 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad46b2-bd3a-4b42-8441-bd27334e42b5 admin admin] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:02.295212 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437ca66-b8be-49d4-97da-18643571b8fc admin admin] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:02.295396 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad46b2-bd3a-4b42-8441-bd27334e42b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:02.295505 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437ca66-b8be-49d4-97da-18643571b8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:02.295670 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad46b2-bd3a-4b42-8441-bd27334e42b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:02.295771 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437ca66-b8be-49d4-97da-18643571b8fc admin admin] PATH_INFO: `/v3/projects` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:02.296329 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad46b2-bd3a-4b42-8441-bd27334e42b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:39:02.296437 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437ca66-b8be-49d4-97da-18643571b8fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:39:02.297323 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: WARNING py.warnings [None req-56ad46b2-bd3a-4b42-8441-bd27334e42b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 12:39:02.297323 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: warnings.warn(msg) Jul 27 12:39:02.297323 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: Jul 27 12:39:02.298225 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437ca66-b8be-49d4-97da-18643571b8fc admin admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:39:02.298525 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad46b2-bd3a-4b42-8441-bd27334e42b5 admin admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:39:02.334753 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 581/1163] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Jul 27 12:39:02 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 12:39:02.340264 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 583/1164] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Jul 27 12:39:02 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 12:39:02.340418 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad46b2-bd3a-4b42-8441-bd27334e42b5 admin admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:39:02.341303 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437ca66-b8be-49d4-97da-18643571b8fc admin admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:39:02.401248 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad46b2-bd3a-4b42-8441-bd27334e42b5 admin admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:39:02.403763 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437ca66-b8be-49d4-97da-18643571b8fc admin admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:39:02.405953 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57b285-4410-4ba7-9941-4e8e08ce470b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:39:02.406563 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57b285-4410-4ba7-9941-4e8e08ce470b admin admin] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:02.406843 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57b285-4410-4ba7-9941-4e8e08ce470b admin admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:02.407121 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57b285-4410-4ba7-9941-4e8e08ce470b admin admin] PATH_INFO: `/v3/users` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:02.407777 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f57b285-4410-4ba7-9941-4e8e08ce470b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:39:02.408416 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd25ac4-315d-425e-808d-3e93b31687ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:39:02.409029 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd25ac4-315d-425e-808d-3e93b31687ab admin admin] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:02.409315 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd25ac4-315d-425e-808d-3e93b31687ab admin admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:02.409612 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd25ac4-315d-425e-808d-3e93b31687ab admin admin] PATH_INFO: `/v3/users` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:02.409721 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f57b285-4410-4ba7-9941-4e8e08ce470b admin admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:39:02.410283 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd25ac4-315d-425e-808d-3e93b31687ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:39:02.411327 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: WARNING py.warnings [None req-efd25ac4-315d-425e-808d-3e93b31687ab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 12:39:02.411327 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: warnings.warn(msg) Jul 27 12:39:02.411327 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: Jul 27 12:39:02.412539 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd25ac4-315d-425e-808d-3e93b31687ab admin admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:39:02.432254 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 582/1165] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Jul 27 12:39:02 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 12:39:02.436188 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57b285-4410-4ba7-9941-4e8e08ce470b admin admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:39:02.437895 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 584/1166] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Jul 27 12:39:02 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 12:39:02.438761 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd25ac4-315d-425e-808d-3e93b31687ab admin admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:39:02.445968 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57b285-4410-4ba7-9941-4e8e08ce470b admin admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:39:02.449119 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd25ac4-315d-425e-808d-3e93b31687ab admin admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:39:02.450475 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d1688-c77f-4000-a794-04ec9c3f9d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:39:02.451064 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d1688-c77f-4000-a794-04ec9c3f9d38 admin admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:02.451345 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d1688-c77f-4000-a794-04ec9c3f9d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:02.451618 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d1688-c77f-4000-a794-04ec9c3f9d38 admin admin] PATH_INFO: `/v3/roles` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:02.452305 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d1688-c77f-4000-a794-04ec9c3f9d38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:39:02.453721 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb5549-e74c-4056-89bb-6423306ec542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:39:02.453905 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d1688-c77f-4000-a794-04ec9c3f9d38 admin admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:39:02.454319 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb5549-e74c-4056-89bb-6423306ec542 admin admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:02.454604 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb5549-e74c-4056-89bb-6423306ec542 admin admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:02.454887 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb5549-e74c-4056-89bb-6423306ec542 admin admin] PATH_INFO: `/v3/roles` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:02.455569 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb5549-e74c-4056-89bb-6423306ec542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:39:02.457267 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb5549-e74c-4056-89bb-6423306ec542 admin admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:39:02.464163 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 583/1167] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Jul 27 12:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 12:39:02.467702 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 585/1168] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Jul 27 12:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 12:39:02.468105 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d1688-c77f-4000-a794-04ec9c3f9d38 admin admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:39:02.471266 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb5549-e74c-4056-89bb-6423306ec542 admin admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:39:02.477964 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d1688-c77f-4000-a794-04ec9c3f9d38 admin admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:39:02.481160 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb5549-e74c-4056-89bb-6423306ec542 admin admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:39:02.482492 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98818f78-82a0-4543-a892-5f1eaf9302b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:39:02.483073 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98818f78-82a0-4543-a892-5f1eaf9302b4 admin admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:02.483358 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98818f78-82a0-4543-a892-5f1eaf9302b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:02.483629 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98818f78-82a0-4543-a892-5f1eaf9302b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:02.484298 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98818f78-82a0-4543-a892-5f1eaf9302b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:39:02.485864 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98818f78-82a0-4543-a892-5f1eaf9302b4 admin admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:39:02.486055 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17089291-f98c-46eb-843e-0d4403a8b197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:39:02.486670 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17089291-f98c-46eb-843e-0d4403a8b197 admin admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:02.487229 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17089291-f98c-46eb-843e-0d4403a8b197 admin admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:02.487514 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17089291-f98c-46eb-843e-0d4403a8b197 admin admin] PATH_INFO: `/v3/roles` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:02.488530 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17089291-f98c-46eb-843e-0d4403a8b197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:39:02.490148 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17089291-f98c-46eb-843e-0d4403a8b197 admin admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:39:02.496449 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 584/1169] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Jul 27 12:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 12:39:02.500339 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98818f78-82a0-4543-a892-5f1eaf9302b4 admin admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:39:02.504393 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 586/1170] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Jul 27 12:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 12:39:02.505284 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17089291-f98c-46eb-843e-0d4403a8b197 admin admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:39:02.509700 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98818f78-82a0-4543-a892-5f1eaf9302b4 admin admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:39:02.514260 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41257f48-c6bd-4068-a11c-246e0c7a8299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:39:02.514889 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41257f48-c6bd-4068-a11c-246e0c7a8299 admin admin] REQUEST_METHOD: `PUT` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:02.515169 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41257f48-c6bd-4068-a11c-246e0c7a8299 admin admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:02.515440 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41257f48-c6bd-4068-a11c-246e0c7a8299 admin admin] PATH_INFO: `/v3/projects/9ea9ff9bd98e4563a6e32821f080ab4f/users/d36bba6dfcd94049a894e7f11ce92c6e/roles/2136377433854360927c578b39f16e6f` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:02.515690 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17089291-f98c-46eb-843e-0d4403a8b197 admin admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:39:02.520230 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b28dc0-404a-49da-9fad-2fb0c53c8421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:39:02.520870 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b28dc0-404a-49da-9fad-2fb0c53c8421 admin admin] REQUEST_METHOD: `PUT` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:02.521158 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b28dc0-404a-49da-9fad-2fb0c53c8421 admin admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:02.521433 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b28dc0-404a-49da-9fad-2fb0c53c8421 admin admin] PATH_INFO: `/v3/projects/719d22382d1141e6a2daee3d33467c66/users/5cfc6a65c2c64ef0bf5c071cbbddd20e/roles/2136377433854360927c578b39f16e6f` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:02.530320 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41257f48-c6bd-4068-a11c-246e0c7a8299 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ea9ff9bd98e4563a6e32821f080ab4f, user_id=d36bba6dfcd94049a894e7f11ce92c6e, role_id=2136377433854360927c578b39f16e6f)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:39:02.531333 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: WARNING py.warnings [None req-41257f48-c6bd-4068-a11c-246e0c7a8299 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 12:39:02.531333 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: warnings.warn(msg) Jul 27 12:39:02.531333 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: Jul 27 12:39:02.533237 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41257f48-c6bd-4068-a11c-246e0c7a8299 admin admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:39:02.536381 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b28dc0-404a-49da-9fad-2fb0c53c8421 admin admin] RBAC: Authorizing `identity:create_grant(project_id=719d22382d1141e6a2daee3d33467c66, user_id=5cfc6a65c2c64ef0bf5c071cbbddd20e, role_id=2136377433854360927c578b39f16e6f)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:39:02.539150 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b28dc0-404a-49da-9fad-2fb0c53c8421 admin admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:39:02.547158 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 585/1171] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Jul 27 12:39:02 2022] PUT /identity/v3/projects/9ea9ff9bd98e4563a6e32821f080ab4f/users/d36bba6dfcd94049a894e7f11ce92c6e/roles/2136377433854360927c578b39f16e6f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 12:39:02.552530 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 587/1172] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Jul 27 12:39:02 2022] PUT /identity/v3/projects/719d22382d1141e6a2daee3d33467c66/users/5cfc6a65c2c64ef0bf5c071cbbddd20e/roles/2136377433854360927c578b39f16e6f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 12:39:02.554427 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a192474-fbda-4160-9565-1b79d7091770 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:02.554716 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a192474-fbda-4160-9565-1b79d7091770 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:02.554993 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a192474-fbda-4160-9565-1b79d7091770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:02.557839 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76347806-8442-4ac7-a87e-c3c7f8ad7672 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:02.558129 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76347806-8442-4ac7-a87e-c3c7f8ad7672 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:02.558410 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76347806-8442-4ac7-a87e-c3c7f8ad7672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:02.574144 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-3a192474-fbda-4160-9565-1b79d7091770 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:39:02.575351 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-3a192474-fbda-4160-9565-1b79d7091770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:39:02.576883 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-76347806-8442-4ac7-a87e-c3c7f8ad7672 None None] MFA Rules not processed for user `39c655ecdea3454d98a7abe23dc966e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:39:02.578164 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-76347806-8442-4ac7-a87e-c3c7f8ad7672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:39:02.617212 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:39:02.621121 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:39:02.636553 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 586/1173] 10.222.0.55 () {58 vars in 958 bytes} [Wed Jul 27 12:39:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 12:39:02.639996 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 588/1174] 10.222.0.55 () {58 vars in 958 bytes} [Wed Jul 27 12:39:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 12:39:02.647650 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a192474-fbda-4160-9565-1b79d7091770 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:39:02.650094 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76347806-8442-4ac7-a87e-c3c7f8ad7672 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:39:02.703381 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a192474-fbda-4160-9565-1b79d7091770 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:39:02.706949 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab8477-47a7-4fdf-b9e2-47efe4bd34e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645587202a91426c98f86abdcddce8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:39:02.707563 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab8477-47a7-4fdf-b9e2-47efe4bd34e6 service neutron] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:02.707841 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab8477-47a7-4fdf-b9e2-47efe4bd34e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:02.708113 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab8477-47a7-4fdf-b9e2-47efe4bd34e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:02.711074 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76347806-8442-4ac7-a87e-c3c7f8ad7672 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:39:02.714738 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fabb9-4239-4322-90aa-7e3500f5bf4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645587202a91426c98f86abdcddce8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:39:02.715359 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fabb9-4239-4322-90aa-7e3500f5bf4b service neutron] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:02.715638 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fabb9-4239-4322-90aa-7e3500f5bf4b service neutron] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:02.715917 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fabb9-4239-4322-90aa-7e3500f5bf4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:02.717619 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab8477-47a7-4fdf-b9e2-47efe4bd34e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:39:02.719063 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab8477-47a7-4fdf-b9e2-47efe4bd34e6 service neutron] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:39:02.725333 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9fabb9-4239-4322-90aa-7e3500f5bf4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:39:02.726788 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9fabb9-4239-4322-90aa-7e3500f5bf4b service neutron] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:39:02.728677 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 587/1175] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:39:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:39:02.736405 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 589/1176] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:39:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 12:39:08.884864 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae52c7-d1ce-49fb-95e4-8286d7c16fe9 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:08.885395 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae52c7-d1ce-49fb-95e4-8286d7c16fe9 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:08.885395 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae52c7-d1ce-49fb-95e4-8286d7c16fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:08.924748 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-baae52c7-d1ce-49fb-95e4-8286d7c16fe9 None None] MFA Rules not processed for user `5cfc6a65c2c64ef0bf5c071cbbddd20e`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:39:08.926127 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-baae52c7-d1ce-49fb-95e4-8286d7c16fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:39:09.019614 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 588/1177] 10.222.0.55 () {58 vars in 958 bytes} [Wed Jul 27 12:39:08 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:39:09.024058 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fabb9-4239-4322-90aa-7e3500f5bf4b service neutron] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:39:09.035019 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9fabb9-4239-4322-90aa-7e3500f5bf4b service neutron] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:39:09.049508 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea26e0-c054-4773-9608-387431851284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:39:09.050179 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea26e0-c054-4773-9608-387431851284 admin admin] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:09.050462 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea26e0-c054-4773-9608-387431851284 admin admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:09.050739 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea26e0-c054-4773-9608-387431851284 admin admin] PATH_INFO: `/v3/projects` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:09.051430 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caea26e0-c054-4773-9608-387431851284 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:39:09.053963 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caea26e0-c054-4773-9608-387431851284 admin admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:39:09.107807 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae52c7-d1ce-49fb-95e4-8286d7c16fe9 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:39:09.118037 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 590/1178] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Jul 27 12:39:09 2022] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 12:39:09.119948 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae52c7-d1ce-49fb-95e4-8286d7c16fe9 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:39:09.256021 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8f055-16ef-4faa-ade1-af553df89cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:39:09.258279 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8f055-16ef-4faa-ade1-af553df89cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:09.258768 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8f055-16ef-4faa-ade1-af553df89cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:09.259050 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8f055-16ef-4faa-ade1-af553df89cd9 admin admin] PATH_INFO: `/v3/users` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:09.259749 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8f055-16ef-4faa-ade1-af553df89cd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:39:09.262280 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8f055-16ef-4faa-ade1-af553df89cd9 admin admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:39:09.305960 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea26e0-c054-4773-9608-387431851284 admin admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:39:09.312708 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 589/1179] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Jul 27 12:39:09 2022] POST /identity/v3/users => generated 295 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 12:39:09.316967 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea26e0-c054-4773-9608-387431851284 admin admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:39:09.326058 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb52b05-294c-4ea5-af66-50463e293cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:39:09.326871 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb52b05-294c-4ea5-af66-50463e293cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:09.327185 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb52b05-294c-4ea5-af66-50463e293cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:09.327488 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb52b05-294c-4ea5-af66-50463e293cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:09.328259 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb52b05-294c-4ea5-af66-50463e293cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:39:09.329953 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb52b05-294c-4ea5-af66-50463e293cb6 admin admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:39:09.352185 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8f055-16ef-4faa-ade1-af553df89cd9 admin admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:39:09.368248 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8f055-16ef-4faa-ade1-af553df89cd9 admin admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:39:09.369545 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 591/1180] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Jul 27 12:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 12:39:09.376026 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734aa892-63f8-49a9-a960-c84fa3dfbe41 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:09.376325 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734aa892-63f8-49a9-a960-c84fa3dfbe41 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:09.377269 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734aa892-63f8-49a9-a960-c84fa3dfbe41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:09.382068 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa148a-94ef-4e98-998f-6f94421059f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:39:09.383117 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa148a-94ef-4e98-998f-6f94421059f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:09.384180 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa148a-94ef-4e98-998f-6f94421059f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:09.389751 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa148a-94ef-4e98-998f-6f94421059f8 admin admin] PATH_INFO: `/v3/projects/0b73b37a64f2417cbdc167091e509513/users/3532bf2ac8bb452faa5350a47d40143a/roles/af00ed97066e4c72aeb6cd3d5b5d15c9` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:09.394625 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:39:09.413543 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaa148a-94ef-4e98-998f-6f94421059f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b73b37a64f2417cbdc167091e509513, user_id=3532bf2ac8bb452faa5350a47d40143a, role_id=af00ed97066e4c72aeb6cd3d5b5d15c9)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:39:09.417052 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-734aa892-63f8-49a9-a960-c84fa3dfbe41 None None] MFA Rules not processed for user `d36bba6dfcd94049a894e7f11ce92c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:39:09.417663 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaa148a-94ef-4e98-998f-6f94421059f8 admin admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:39:09.418385 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-734aa892-63f8-49a9-a960-c84fa3dfbe41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:39:09.442315 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 590/1181] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Jul 27 12:39:09 2022] PUT /identity/v3/projects/0b73b37a64f2417cbdc167091e509513/users/3532bf2ac8bb452faa5350a47d40143a/roles/af00ed97066e4c72aeb6cd3d5b5d15c9 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 12:39:09.446590 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa148a-94ef-4e98-998f-6f94421059f8 admin admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:39:09.565379 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 592/1182] 10.222.0.55 () {58 vars in 958 bytes} [Wed Jul 27 12:39:09 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:39:09.568035 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734aa892-63f8-49a9-a960-c84fa3dfbe41 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:39:09.569059 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa148a-94ef-4e98-998f-6f94421059f8 admin admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:39:09.583263 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734aa892-63f8-49a9-a960-c84fa3dfbe41 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:39:09.584908 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427cb41e-d625-4331-b303-7218265c97bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:39:09.585876 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427cb41e-d625-4331-b303-7218265c97bd admin admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:09.586358 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427cb41e-d625-4331-b303-7218265c97bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:09.587336 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427cb41e-d625-4331-b303-7218265c97bd admin admin] PATH_INFO: `/v3/roles` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:09.588329 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427cb41e-d625-4331-b303-7218265c97bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:39:09.588834 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35082625-4914-4105-838b-29e72f1d57ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:39:09.589471 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35082625-4914-4105-838b-29e72f1d57ba admin admin] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:09.589796 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35082625-4914-4105-838b-29e72f1d57ba admin admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:09.590076 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35082625-4914-4105-838b-29e72f1d57ba admin admin] PATH_INFO: `/v3/projects` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:09.590752 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35082625-4914-4105-838b-29e72f1d57ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:39:09.591478 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427cb41e-d625-4331-b303-7218265c97bd admin admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:39:09.592659 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35082625-4914-4105-838b-29e72f1d57ba admin admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:39:09.605976 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 591/1183] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Jul 27 12:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 12:39:09.610533 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427cb41e-d625-4331-b303-7218265c97bd admin admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:39:09.622148 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427cb41e-d625-4331-b303-7218265c97bd admin admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:39:09.627441 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29717d0-5359-4b5a-ac86-cd8fa6de848f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:39:09.628601 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29717d0-5359-4b5a-ac86-cd8fa6de848f admin admin] REQUEST_METHOD: `PUT` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:09.629159 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29717d0-5359-4b5a-ac86-cd8fa6de848f admin admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:09.629757 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29717d0-5359-4b5a-ac86-cd8fa6de848f admin admin] PATH_INFO: `/v3/projects/0b73b37a64f2417cbdc167091e509513/users/3532bf2ac8bb452faa5350a47d40143a/roles/af00ed97066e4c72aeb6cd3d5b5d15c9` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:09.633069 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29717d0-5359-4b5a-ac86-cd8fa6de848f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b73b37a64f2417cbdc167091e509513, user_id=3532bf2ac8bb452faa5350a47d40143a, role_id=af00ed97066e4c72aeb6cd3d5b5d15c9)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:39:09.636191 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29717d0-5359-4b5a-ac86-cd8fa6de848f admin admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:39:09.644347 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 593/1184] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Jul 27 12:39:09 2022] POST /identity/v3/projects => generated 383 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 12:39:09.649101 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35082625-4914-4105-838b-29e72f1d57ba admin admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:39:09.650318 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 592/1185] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Jul 27 12:39:09 2022] PUT /identity/v3/projects/0b73b37a64f2417cbdc167091e509513/users/3532bf2ac8bb452faa5350a47d40143a/roles/af00ed97066e4c72aeb6cd3d5b5d15c9 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 12:39:09.697280 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:39:09.745988 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35082625-4914-4105-838b-29e72f1d57ba admin admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:39:09.751158 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536028c8-0b7d-4dea-95fd-aecb0d4ce163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:39:09.751898 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536028c8-0b7d-4dea-95fd-aecb0d4ce163 admin admin] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:09.752250 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536028c8-0b7d-4dea-95fd-aecb0d4ce163 admin admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:09.752651 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536028c8-0b7d-4dea-95fd-aecb0d4ce163 admin admin] PATH_INFO: `/v3/users` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:09.753336 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536028c8-0b7d-4dea-95fd-aecb0d4ce163 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:39:09.755544 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536028c8-0b7d-4dea-95fd-aecb0d4ce163 admin admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:39:09.779084 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 594/1186] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Jul 27 12:39:09 2022] POST /identity/v3/users => generated 298 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 12:39:09.782674 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29717d0-5359-4b5a-ac86-cd8fa6de848f admin admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:39:09.891289 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29717d0-5359-4b5a-ac86-cd8fa6de848f admin admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:39:09.897811 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c93f3-445e-4e18-80a8-a7e08e0689bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:39:09.898555 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c93f3-445e-4e18-80a8-a7e08e0689bf admin admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:09.898945 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c93f3-445e-4e18-80a8-a7e08e0689bf admin admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:09.899322 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c93f3-445e-4e18-80a8-a7e08e0689bf admin admin] PATH_INFO: `/v3/roles` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:09.900117 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c93f3-445e-4e18-80a8-a7e08e0689bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:39:09.901836 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c93f3-445e-4e18-80a8-a7e08e0689bf admin admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:39:09.917328 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 593/1187] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Jul 27 12:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 12:39:09.918616 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536028c8-0b7d-4dea-95fd-aecb0d4ce163 admin admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:39:09.930516 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536028c8-0b7d-4dea-95fd-aecb0d4ce163 admin admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:39:09.938249 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c93d2-2035-4bef-bd33-3d053fb57bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:39:09.939146 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c93d2-2035-4bef-bd33-3d053fb57bde admin admin] REQUEST_METHOD: `PUT` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:09.939783 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c93d2-2035-4bef-bd33-3d053fb57bde admin admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:09.940052 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c93d2-2035-4bef-bd33-3d053fb57bde admin admin] PATH_INFO: `/v3/projects/e9aab62d16754c2482194a3bf0321e3c/users/4b988807d44248479fc06c13e4ad2198/roles/af00ed97066e4c72aeb6cd3d5b5d15c9` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:09.960221 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3c93d2-2035-4bef-bd33-3d053fb57bde admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9aab62d16754c2482194a3bf0321e3c, user_id=4b988807d44248479fc06c13e4ad2198, role_id=af00ed97066e4c72aeb6cd3d5b5d15c9)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:39:09.963046 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3c93d2-2035-4bef-bd33-3d053fb57bde admin admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:39:09.984401 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 595/1188] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Jul 27 12:39:09 2022] PUT /identity/v3/projects/e9aab62d16754c2482194a3bf0321e3c/users/4b988807d44248479fc06c13e4ad2198/roles/af00ed97066e4c72aeb6cd3d5b5d15c9 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 12:39:09.985722 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c93f3-445e-4e18-80a8-a7e08e0689bf admin admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:39:09.997768 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c93f3-445e-4e18-80a8-a7e08e0689bf admin admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:39:10.116284 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641f9fa-6b35-4b98-b219-a8805f292447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:39:10.116841 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641f9fa-6b35-4b98-b219-a8805f292447 admin admin] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:10.117127 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641f9fa-6b35-4b98-b219-a8805f292447 admin admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:10.117403 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641f9fa-6b35-4b98-b219-a8805f292447 admin admin] PATH_INFO: `/v3/roles` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:10.119130 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641f9fa-6b35-4b98-b219-a8805f292447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:39:10.121024 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641f9fa-6b35-4b98-b219-a8805f292447 admin admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:39:10.139640 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:39:10.140857 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 594/1189] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Jul 27 12:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 12:39:10.144462 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c93d2-2035-4bef-bd33-3d053fb57bde admin admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:39:10.158909 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c93d2-2035-4bef-bd33-3d053fb57bde admin admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:39:10.167537 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fef464-d1db-41f5-b186-10aeebaeb87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:39:10.168397 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fef464-d1db-41f5-b186-10aeebaeb87b admin admin] REQUEST_METHOD: `PUT` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:10.168789 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fef464-d1db-41f5-b186-10aeebaeb87b admin admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:10.169196 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fef464-d1db-41f5-b186-10aeebaeb87b admin admin] PATH_INFO: `/v3/projects/e9aab62d16754c2482194a3bf0321e3c/users/4b988807d44248479fc06c13e4ad2198/roles/af00ed97066e4c72aeb6cd3d5b5d15c9` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:10.171493 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fef464-d1db-41f5-b186-10aeebaeb87b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9aab62d16754c2482194a3bf0321e3c, user_id=4b988807d44248479fc06c13e4ad2198, role_id=af00ed97066e4c72aeb6cd3d5b5d15c9)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:39:10.174932 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fef464-d1db-41f5-b186-10aeebaeb87b admin admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:39:10.191148 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 596/1190] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Jul 27 12:39:10 2022] PUT /identity/v3/projects/e9aab62d16754c2482194a3bf0321e3c/users/4b988807d44248479fc06c13e4ad2198/roles/af00ed97066e4c72aeb6cd3d5b5d15c9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 12:39:15.740968 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67927658-ac1c-47fd-94d6-91cebef6ce3f None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:15.742807 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67927658-ac1c-47fd-94d6-91cebef6ce3f None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:15.743190 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67927658-ac1c-47fd-94d6-91cebef6ce3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:15.794367 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-67927658-ac1c-47fd-94d6-91cebef6ce3f None None] MFA Rules not processed for user `3532bf2ac8bb452faa5350a47d40143a`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:39:15.795927 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-67927658-ac1c-47fd-94d6-91cebef6ce3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:39:15.930297 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 595/1191] 10.222.0.55 () {58 vars in 958 bytes} [Wed Jul 27 12:39:15 2022] POST /identity/v3/auth/tokens => generated 2871 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:39:15.946125 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fef464-d1db-41f5-b186-10aeebaeb87b admin admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:39:15.948283 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-91fef464-d1db-41f5-b186-10aeebaeb87b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:39:16.089165 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fef464-d1db-41f5-b186-10aeebaeb87b admin admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:39:16.094420 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f8ce1-a2da-4615-b21c-bb4969bf7d27 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a436eb33e8b040d192f1cfc9771fd351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:39:16.095160 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f8ce1-a2da-4615-b21c-bb4969bf7d27 service glance] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:16.095361 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f8ce1-a2da-4615-b21c-bb4969bf7d27 service glance] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:16.095643 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f8ce1-a2da-4615-b21c-bb4969bf7d27 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:16.199260 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338f8ce1-a2da-4615-b21c-bb4969bf7d27 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:39:16.201555 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338f8ce1-a2da-4615-b21c-bb4969bf7d27 service glance] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:39:16.244255 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 597/1192] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:39:15 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:39:16.781344 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63469b37-9910-41cf-a105-fef4e36996f2 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:16.782293 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63469b37-9910-41cf-a105-fef4e36996f2 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:16.782734 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63469b37-9910-41cf-a105-fef4e36996f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:16.829786 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-63469b37-9910-41cf-a105-fef4e36996f2 None None] MFA Rules not processed for user `4b988807d44248479fc06c13e4ad2198`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:39:16.831246 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-63469b37-9910-41cf-a105-fef4e36996f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:39:16.983038 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 596/1193] 10.222.0.55 () {58 vars in 958 bytes} [Wed Jul 27 12:39:16 2022] POST /identity/v3/auth/tokens => generated 2877 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:39:16.997987 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f8ce1-a2da-4615-b21c-bb4969bf7d27 service glance] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:39:17.000743 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-338f8ce1-a2da-4615-b21c-bb4969bf7d27 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:39:17.016920 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f8ce1-a2da-4615-b21c-bb4969bf7d27 service glance] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:39:17.022429 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0883c44-f817-419b-82d3-0be703d12fb0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a436eb33e8b040d192f1cfc9771fd351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:39:17.023346 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0883c44-f817-419b-82d3-0be703d12fb0 service glance] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:17.023807 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0883c44-f817-419b-82d3-0be703d12fb0 service glance] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:17.024514 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0883c44-f817-419b-82d3-0be703d12fb0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:17.044533 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:39:17.116267 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0883c44-f817-419b-82d3-0be703d12fb0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:39:17.117974 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0883c44-f817-419b-82d3-0be703d12fb0 service glance] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:39:17.128841 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 598/1194] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:39:16 2022] GET /identity/v3/auth/tokens => generated 2810 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:39:25.954680 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0324a-fd03-4942-8f70-059c2cef0bc0 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:25.955269 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0324a-fd03-4942-8f70-059c2cef0bc0 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:25.955505 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0324a-fd03-4942-8f70-059c2cef0bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:25.977616 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-a2d0324a-fd03-4942-8f70-059c2cef0bc0 None None] MFA Rules not processed for user `d36bba6dfcd94049a894e7f11ce92c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:39:25.978827 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-a2d0324a-fd03-4942-8f70-059c2cef0bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:39:25.985686 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 597/1195] 10.222.0.55 () {58 vars in 958 bytes} [Wed Jul 27 12:39:25 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:39:26.296800 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5c92f-1e22-4fdc-a484-7af1f0c958de None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:26.298006 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5c92f-1e22-4fdc-a484-7af1f0c958de None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:26.298508 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5c92f-1e22-4fdc-a484-7af1f0c958de None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:26.302398 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 599/1196] 10.222.0.55 () {54 vars in 962 bytes} [Wed Jul 27 12:39:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:39:26.308461 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a666976-0f69-4510-aecb-9e851a2064a3 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:26.309353 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a666976-0f69-4510-aecb-9e851a2064a3 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:26.310003 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a666976-0f69-4510-aecb-9e851a2064a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:26.344574 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-2a666976-0f69-4510-aecb-9e851a2064a3 None None] MFA Rules not processed for user `36964c4644584d4282b04596ad20717c`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:39:26.345804 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-2a666976-0f69-4510-aecb-9e851a2064a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:39:26.404722 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=100 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:39:26.422966 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 598/1197] 10.222.0.55 () {58 vars in 1059 bytes} [Wed Jul 27 12:39:26 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 12:39:26.429131 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b50c5-08b6-4bc7-82eb-3ec5ee954d52 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:26.429407 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b50c5-08b6-4bc7-82eb-3ec5ee954d52 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:26.429720 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b50c5-08b6-4bc7-82eb-3ec5ee954d52 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:26.431050 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 600/1198] 10.222.0.55 () {54 vars in 912 bytes} [Wed Jul 27 12:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:39:26.436025 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451a458-7462-4fcf-b1ba-d69cb1f4f8c2 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:26.436348 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451a458-7462-4fcf-b1ba-d69cb1f4f8c2 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:26.436629 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451a458-7462-4fcf-b1ba-d69cb1f4f8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:26.457731 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-4451a458-7462-4fcf-b1ba-d69cb1f4f8c2 None None] MFA Rules not processed for user `36964c4644584d4282b04596ad20717c`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:39:26.459003 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-4451a458-7462-4fcf-b1ba-d69cb1f4f8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:39:26.468779 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 599/1199] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jul 27 12:39:26 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:39:26.486866 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b50c5-08b6-4bc7-82eb-3ec5ee954d52 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:39:26.499316 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b50c5-08b6-4bc7-82eb-3ec5ee954d52 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:39:26.502934 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf12a5d-e571-4002-a357-e7d4214f00ae service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a436eb33e8b040d192f1cfc9771fd351', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:39:26.503745 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf12a5d-e571-4002-a357-e7d4214f00ae service glance] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:26.504210 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf12a5d-e571-4002-a357-e7d4214f00ae service glance] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:26.504488 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf12a5d-e571-4002-a357-e7d4214f00ae service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:26.515809 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf12a5d-e571-4002-a357-e7d4214f00ae service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:39:26.517317 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf12a5d-e571-4002-a357-e7d4214f00ae service glance] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:39:26.533841 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 601/1200] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:39:26 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 12:39:27.059930 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469089ed-e46e-4dd7-a480-06fe53332d5a None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:27.060515 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469089ed-e46e-4dd7-a480-06fe53332d5a None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:27.060723 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469089ed-e46e-4dd7-a480-06fe53332d5a None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:27.062285 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 600/1201] 10.222.0.55 () {54 vars in 912 bytes} [Wed Jul 27 12:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:39:27.068772 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23796e8-e2c8-4153-89cc-798782d4eb71 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:27.069231 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23796e8-e2c8-4153-89cc-798782d4eb71 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:27.069476 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23796e8-e2c8-4153-89cc-798782d4eb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:27.111394 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-b23796e8-e2c8-4153-89cc-798782d4eb71 None None] MFA Rules not processed for user `645587202a91426c98f86abdcddce8cd`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:39:27.112841 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-b23796e8-e2c8-4153-89cc-798782d4eb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:39:27.185772 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 602/1202] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jul 27 12:39:27 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:39:27.196978 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469089ed-e46e-4dd7-a480-06fe53332d5a None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:39:27.211949 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469089ed-e46e-4dd7-a480-06fe53332d5a None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:39:27.218310 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b618d-9cec-49b5-a79e-c7a9c31f8aed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645587202a91426c98f86abdcddce8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:39:27.219073 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b618d-9cec-49b5-a79e-c7a9c31f8aed service neutron] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:27.219648 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b618d-9cec-49b5-a79e-c7a9c31f8aed service neutron] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:27.220160 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b618d-9cec-49b5-a79e-c7a9c31f8aed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:27.230076 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b618d-9cec-49b5-a79e-c7a9c31f8aed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:39:27.232530 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b618d-9cec-49b5-a79e-c7a9c31f8aed service neutron] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:39:27.263923 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 601/1203] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:39:27 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:39:27.704076 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a826e10-936e-4bae-827e-28872d7fe4dd None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:27.704670 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a826e10-936e-4bae-827e-28872d7fe4dd None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:27.704670 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a826e10-936e-4bae-827e-28872d7fe4dd None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:27.706779 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 603/1204] 10.222.0.55 () {54 vars in 962 bytes} [Wed Jul 27 12:39:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:39:27.711814 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f3efe-3db6-40d6-b7ff-0e1ba677c1ca None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:27.712281 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f3efe-3db6-40d6-b7ff-0e1ba677c1ca None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:27.712739 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f3efe-3db6-40d6-b7ff-0e1ba677c1ca None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:27.715177 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 602/1205] 10.222.0.55 () {54 vars in 961 bytes} [Wed Jul 27 12:39:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:39:27.717042 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369cf7f3-cef4-4dd6-9068-16dcb70653c7 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:27.717515 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369cf7f3-cef4-4dd6-9068-16dcb70653c7 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:27.718014 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369cf7f3-cef4-4dd6-9068-16dcb70653c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:27.720493 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92e470-782b-4dda-80bd-bc2bc121ef52 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:27.720992 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92e470-782b-4dda-80bd-bc2bc121ef52 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:27.721365 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92e470-782b-4dda-80bd-bc2bc121ef52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:27.745675 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-9f92e470-782b-4dda-80bd-bc2bc121ef52 None None] MFA Rules not processed for user `6cc3f626dcb5495c9eed35a8e50092e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:39:27.747560 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-9f92e470-782b-4dda-80bd-bc2bc121ef52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:39:27.750112 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-369cf7f3-cef4-4dd6-9068-16dcb70653c7 None None] MFA Rules not processed for user `36964c4644584d4282b04596ad20717c`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:39:27.751352 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-369cf7f3-cef4-4dd6-9068-16dcb70653c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:39:27.775898 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 604/1206] 10.222.0.55 () {58 vars in 1059 bytes} [Wed Jul 27 12:39:27 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:39:27.783239 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05800d0a-2ec4-488e-8a6c-c8474a2738e3 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:27.784770 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05800d0a-2ec4-488e-8a6c-c8474a2738e3 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:27.786213 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05800d0a-2ec4-488e-8a6c-c8474a2738e3 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:27.788838 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 605/1207] 10.222.0.55 () {54 vars in 912 bytes} [Wed Jul 27 12:39:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:39:27.798975 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89200592-ab83-451f-b967-153073f15a1b None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:27.799285 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89200592-ab83-451f-b967-153073f15a1b None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:27.799545 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89200592-ab83-451f-b967-153073f15a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:27.835973 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-89200592-ab83-451f-b967-153073f15a1b None None] MFA Rules not processed for user `36964c4644584d4282b04596ad20717c`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:39:27.837456 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-89200592-ab83-451f-b967-153073f15a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:39:27.854875 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 606/1208] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jul 27 12:39:27 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 12:39:27.865975 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 603/1209] 10.222.0.55 () {58 vars in 1058 bytes} [Wed Jul 27 12:39:27 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:39:27.872832 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89200592-ab83-451f-b967-153073f15a1b None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:39:27.874383 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92e470-782b-4dda-80bd-bc2bc121ef52 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:39:27.891636 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89200592-ab83-451f-b967-153073f15a1b None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:39:27.895027 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92e470-782b-4dda-80bd-bc2bc121ef52 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:39:27.904596 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce8d8a-b5e9-463d-9654-c26231cdc955 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc3f626dcb5495c9eed35a8e50092e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:39:27.905244 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce8d8a-b5e9-463d-9654-c26231cdc955 service placement] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:27.905528 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce8d8a-b5e9-463d-9654-c26231cdc955 service placement] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:27.905879 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce8d8a-b5e9-463d-9654-c26231cdc955 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:27.907652 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62682444-12b6-44b4-902c-787642c01525 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645587202a91426c98f86abdcddce8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:39:27.907800 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-17ce8d8a-b5e9-463d-9654-c26231cdc955 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:39:27.909086 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62682444-12b6-44b4-902c-787642c01525 service neutron] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:27.909467 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62682444-12b6-44b4-902c-787642c01525 service neutron] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:27.910078 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62682444-12b6-44b4-902c-787642c01525 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:27.923999 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce8d8a-b5e9-463d-9654-c26231cdc955 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:39:27.929145 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62682444-12b6-44b4-902c-787642c01525 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:39:27.929957 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce8d8a-b5e9-463d-9654-c26231cdc955 service placement] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:39:27.930786 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62682444-12b6-44b4-902c-787642c01525 service neutron] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:39:27.946042 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 604/1210] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:39:27 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:39:27.947947 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 607/1211] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:39:27 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:39:37.548938 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730c568-1100-4b04-b7eb-02579b6edeab None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:37.549622 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730c568-1100-4b04-b7eb-02579b6edeab None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:37.549622 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730c568-1100-4b04-b7eb-02579b6edeab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:37.571154 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-6730c568-1100-4b04-b7eb-02579b6edeab None None] MFA Rules not processed for user `645587202a91426c98f86abdcddce8cd`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:39:37.572173 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-6730c568-1100-4b04-b7eb-02579b6edeab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:39:37.579215 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 605/1212] 10.222.0.43 () {58 vars in 1015 bytes} [Wed Jul 27 12:39:37 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:39:37.590876 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62682444-12b6-44b4-902c-787642c01525 service neutron] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:39:37.600203 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62682444-12b6-44b4-902c-787642c01525 service neutron] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:39:37.603997 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2288231-71d8-40d6-91f5-33ae19d78949 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645587202a91426c98f86abdcddce8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:39:37.604634 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2288231-71d8-40d6-91f5-33ae19d78949 service neutron] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:37.604918 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2288231-71d8-40d6-91f5-33ae19d78949 service neutron] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:37.605194 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2288231-71d8-40d6-91f5-33ae19d78949 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:37.613497 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2288231-71d8-40d6-91f5-33ae19d78949 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:39:37.615596 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2288231-71d8-40d6-91f5-33ae19d78949 service neutron] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:39:37.624060 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 608/1213] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:39:37 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:39:38.531383 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059a854-095f-4028-89f1-572ffd9ef136 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:38.531936 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059a854-095f-4028-89f1-572ffd9ef136 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:38.532518 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059a854-095f-4028-89f1-572ffd9ef136 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:38.534152 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 606/1214] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jul 27 12:39:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:39:38.549578 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae7524-6ead-4829-9a8f-7008a58877c3 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:38.549901 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae7524-6ead-4829-9a8f-7008a58877c3 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:38.550198 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae7524-6ead-4829-9a8f-7008a58877c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:38.591719 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-e1ae7524-6ead-4829-9a8f-7008a58877c3 None None] MFA Rules not processed for user `36964c4644584d4282b04596ad20717c`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:39:38.593207 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-e1ae7524-6ead-4829-9a8f-7008a58877c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:39:38.612292 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 609/1215] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jul 27 12:39:38 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:39:38.638982 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059a854-095f-4028-89f1-572ffd9ef136 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:39:38.671986 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059a854-095f-4028-89f1-572ffd9ef136 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:39:38.680032 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267cc5f4-e559-468e-a179-5c7c5cb665ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36964c4644584d4282b04596ad20717c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:39:38.680668 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cc5f4-e559-468e-a179-5c7c5cb665ab service nova] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:38.680956 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cc5f4-e559-468e-a179-5c7c5cb665ab service nova] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:38.681291 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cc5f4-e559-468e-a179-5c7c5cb665ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:38.695057 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267cc5f4-e559-468e-a179-5c7c5cb665ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:39:38.698130 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267cc5f4-e559-468e-a179-5c7c5cb665ab service nova] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:39:38.720774 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 607/1216] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:39:38 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:39:44.874988 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b94fe2-f520-4c9e-b81e-57bcc4e22916 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:44.875591 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b94fe2-f520-4c9e-b81e-57bcc4e22916 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:44.875591 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b94fe2-f520-4c9e-b81e-57bcc4e22916 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:44.876866 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 610/1217] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jul 27 12:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:39:44.885739 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10493ae4-ef24-441c-8805-28426e1fcaa9 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:44.886244 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10493ae4-ef24-441c-8805-28426e1fcaa9 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:44.886384 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10493ae4-ef24-441c-8805-28426e1fcaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:44.912322 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-10493ae4-ef24-441c-8805-28426e1fcaa9 None None] MFA Rules not processed for user `36964c4644584d4282b04596ad20717c`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:39:44.913551 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-10493ae4-ef24-441c-8805-28426e1fcaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:39:44.922687 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 608/1218] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jul 27 12:39:44 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:39:44.938826 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b94fe2-f520-4c9e-b81e-57bcc4e22916 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:39:44.954442 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b94fe2-f520-4c9e-b81e-57bcc4e22916 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:39:44.960160 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466861d4-c1dc-4ba8-94ae-c66294565928 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36964c4644584d4282b04596ad20717c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:39:44.960787 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466861d4-c1dc-4ba8-94ae-c66294565928 service nova] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:44.961074 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466861d4-c1dc-4ba8-94ae-c66294565928 service nova] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:44.961356 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466861d4-c1dc-4ba8-94ae-c66294565928 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:44.970041 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466861d4-c1dc-4ba8-94ae-c66294565928 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:39:44.971625 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466861d4-c1dc-4ba8-94ae-c66294565928 service nova] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:39:44.982460 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 611/1219] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:39:44 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:39:54.906232 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=61 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:39:54.978153 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=80 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:39:56.766221 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10493ae4-ef24-441c-8805-28426e1fcaa9 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:39:56.775876 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10493ae4-ef24-441c-8805-28426e1fcaa9 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:39:56.779429 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83f653-9e93-49c7-86d3-eb8ecde4aa90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645587202a91426c98f86abdcddce8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:39:56.780038 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83f653-9e93-49c7-86d3-eb8ecde4aa90 service neutron] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:56.780320 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83f653-9e93-49c7-86d3-eb8ecde4aa90 service neutron] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:56.780592 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83f653-9e93-49c7-86d3-eb8ecde4aa90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:56.790558 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d83f653-9e93-49c7-86d3-eb8ecde4aa90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:39:56.792029 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d83f653-9e93-49c7-86d3-eb8ecde4aa90 service neutron] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:39:56.809665 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 609/1220] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:39:56 2022] GET /identity/v3/auth/tokens => generated 2877 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:39:58.955416 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92351f8-70dd-46c6-8e18-724c5c4c5d48 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:58.956005 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92351f8-70dd-46c6-8e18-724c5c4c5d48 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:58.956005 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92351f8-70dd-46c6-8e18-724c5c4c5d48 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:58.957520 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 612/1221] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jul 27 12:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:39:58.965179 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657e0cb-7e92-4dd5-92d1-10a5fa8ccfff None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:58.965724 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657e0cb-7e92-4dd5-92d1-10a5fa8ccfff None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:58.965827 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657e0cb-7e92-4dd5-92d1-10a5fa8ccfff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:58.995560 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-c657e0cb-7e92-4dd5-92d1-10a5fa8ccfff None None] MFA Rules not processed for user `36964c4644584d4282b04596ad20717c`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:39:58.997789 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-c657e0cb-7e92-4dd5-92d1-10a5fa8ccfff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:39:59.009274 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 610/1222] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jul 27 12:39:58 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:39:59.023195 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92351f8-70dd-46c6-8e18-724c5c4c5d48 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:39:59.042026 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92351f8-70dd-46c6-8e18-724c5c4c5d48 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:39:59.062166 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd62969-5c5e-4b9e-9432-fa6360d04451 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36964c4644584d4282b04596ad20717c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:39:59.070635 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd62969-5c5e-4b9e-9432-fa6360d04451 service nova] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:39:59.071026 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd62969-5c5e-4b9e-9432-fa6360d04451 service nova] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:39:59.071676 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd62969-5c5e-4b9e-9432-fa6360d04451 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:39:59.089814 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd62969-5c5e-4b9e-9432-fa6360d04451 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:39:59.094157 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd62969-5c5e-4b9e-9432-fa6360d04451 service nova] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:39:59.115556 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 613/1223] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:39:59 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:40:08.988447 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=9 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:40:09.110364 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=6 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:40:15.260277 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a91c98-101e-4a58-b504-5e979260cbbc None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:40:15.260793 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a91c98-101e-4a58-b504-5e979260cbbc None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:40:15.260894 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a91c98-101e-4a58-b504-5e979260cbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:40:15.279705 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-49a91c98-101e-4a58-b504-5e979260cbbc None None] MFA Rules not processed for user `5cfc6a65c2c64ef0bf5c071cbbddd20e`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:40:15.280937 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-49a91c98-101e-4a58-b504-5e979260cbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:40:15.288651 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 611/1224] 10.222.0.55 () {58 vars in 958 bytes} [Wed Jul 27 12:40:15 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:40:25.275060 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=3 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:40:38.961104 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8616f-ff6e-4ac0-98f9-851423a2d6a1 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:40:38.961563 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8616f-ff6e-4ac0-98f9-851423a2d6a1 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:40:38.961674 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8616f-ff6e-4ac0-98f9-851423a2d6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:40:38.980723 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-bcc8616f-ff6e-4ac0-98f9-851423a2d6a1 None None] MFA Rules not processed for user `5cfc6a65c2c64ef0bf5c071cbbddd20e`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:40:38.981960 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-bcc8616f-ff6e-4ac0-98f9-851423a2d6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:40:38.988703 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 614/1225] 10.222.0.55 () {58 vars in 958 bytes} [Wed Jul 27 12:40:38 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:40:39.405498 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f53a09-e91d-40d4-8b17-2458cba4a664 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:40:39.405971 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f53a09-e91d-40d4-8b17-2458cba4a664 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:40:39.406093 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f53a09-e91d-40d4-8b17-2458cba4a664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:40:39.425360 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-b4f53a09-e91d-40d4-8b17-2458cba4a664 None None] MFA Rules not processed for user `645587202a91426c98f86abdcddce8cd`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:40:39.426592 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-b4f53a09-e91d-40d4-8b17-2458cba4a664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:40:39.433036 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 612/1226] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Jul 27 12:40:39 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:40:39.444522 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8616f-ff6e-4ac0-98f9-851423a2d6a1 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:40:39.453637 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8616f-ff6e-4ac0-98f9-851423a2d6a1 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:40:39.457113 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a56b501-d297-4a9f-aa9b-3118dd4a1e6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645587202a91426c98f86abdcddce8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:40:39.457752 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56b501-d297-4a9f-aa9b-3118dd4a1e6c service neutron] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:40:39.458031 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56b501-d297-4a9f-aa9b-3118dd4a1e6c service neutron] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:40:39.458301 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56b501-d297-4a9f-aa9b-3118dd4a1e6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:40:39.465624 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a56b501-d297-4a9f-aa9b-3118dd4a1e6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:40:39.467157 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a56b501-d297-4a9f-aa9b-3118dd4a1e6c service neutron] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:40:39.474616 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 615/1227] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:40:39 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 12:40:49.420689 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=3 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:40:49.471351 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=9 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:40:53.641652 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bf18f-5805-4789-9b3b-b636ebd73285 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:40:53.642103 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bf18f-5805-4789-9b3b-b636ebd73285 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:40:53.642199 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bf18f-5805-4789-9b3b-b636ebd73285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:40:53.660558 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-889bf18f-5805-4789-9b3b-b636ebd73285 None None] MFA Rules not processed for user `5cfc6a65c2c64ef0bf5c071cbbddd20e`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:40:53.662302 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-889bf18f-5805-4789-9b3b-b636ebd73285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:40:53.669335 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 613/1228] 10.222.0.55 () {58 vars in 958 bytes} [Wed Jul 27 12:40:53 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:41:03.655899 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=3 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:41:48.764178 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363f332-6dae-4178-a83e-689d3b89912b None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:41:48.764663 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363f332-6dae-4178-a83e-689d3b89912b None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:41:48.764748 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363f332-6dae-4178-a83e-689d3b89912b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:41:48.783644 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-e363f332-6dae-4178-a83e-689d3b89912b None None] MFA Rules not processed for user `5cfc6a65c2c64ef0bf5c071cbbddd20e`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:41:48.784845 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-e363f332-6dae-4178-a83e-689d3b89912b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:41:48.792350 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 616/1229] 10.222.0.55 () {58 vars in 958 bytes} [Wed Jul 27 12:41:48 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:41:58.778961 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=3 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:41:59.123773 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889bf18f-5805-4789-9b3b-b636ebd73285 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:41:59.142158 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889bf18f-5805-4789-9b3b-b636ebd73285 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:41:59.146283 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149ac4e-1d1e-4687-b394-50065dacbf14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645587202a91426c98f86abdcddce8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:41:59.146890 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149ac4e-1d1e-4687-b394-50065dacbf14 service neutron] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:41:59.147178 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149ac4e-1d1e-4687-b394-50065dacbf14 service neutron] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:41:59.147455 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149ac4e-1d1e-4687-b394-50065dacbf14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:41:59.156240 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b149ac4e-1d1e-4687-b394-50065dacbf14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:41:59.157691 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b149ac4e-1d1e-4687-b394-50065dacbf14 service neutron] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:41:59.167487 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 614/1230] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:41:59 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:42:09.163435 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=10 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:43:25.044516 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363f332-6dae-4178-a83e-689d3b89912b None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:43:25.066254 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363f332-6dae-4178-a83e-689d3b89912b None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:43:25.071230 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b4645-d3a1-4681-8046-3a146020c08b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc3f626dcb5495c9eed35a8e50092e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:43:25.071875 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b4645-d3a1-4681-8046-3a146020c08b service placement] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:43:25.072157 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b4645-d3a1-4681-8046-3a146020c08b service placement] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:43:25.072440 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b4645-d3a1-4681-8046-3a146020c08b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:43:25.081630 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b4645-d3a1-4681-8046-3a146020c08b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:43:25.083342 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b4645-d3a1-4681-8046-3a146020c08b service placement] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:43:25.092808 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 617/1231] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:43:25 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:43:35.088918 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=10 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:43:47.676465 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d34dc3-ab14-4f87-ac2c-c7619d853933 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:43:47.677087 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d34dc3-ab14-4f87-ac2c-c7619d853933 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:43:47.677087 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d34dc3-ab14-4f87-ac2c-c7619d853933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:43:47.699483 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-d1d34dc3-ab14-4f87-ac2c-c7619d853933 None None] MFA Rules not processed for user `d36bba6dfcd94049a894e7f11ce92c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:43:47.700782 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-d1d34dc3-ab14-4f87-ac2c-c7619d853933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:43:47.708449 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 615/1232] 10.222.0.55 () {58 vars in 958 bytes} [Wed Jul 27 12:43:47 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:43:57.695531 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=3 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:44:09.561707 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38053f26-4b47-4758-a7d5-ac6554d35c58 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:44:09.563120 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38053f26-4b47-4758-a7d5-ac6554d35c58 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:44:09.563120 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38053f26-4b47-4758-a7d5-ac6554d35c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:44:09.582123 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-38053f26-4b47-4758-a7d5-ac6554d35c58 None None] MFA Rules not processed for user `5cfc6a65c2c64ef0bf5c071cbbddd20e`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:44:09.583424 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-38053f26-4b47-4758-a7d5-ac6554d35c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:44:09.590683 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 618/1233] 10.222.0.55 () {58 vars in 958 bytes} [Wed Jul 27 12:44:09 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 12:44:15.965764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d34dc3-ab14-4f87-ac2c-c7619d853933 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:44:15.986388 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d34dc3-ab14-4f87-ac2c-c7619d853933 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:44:15.991543 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ae508-b69a-4558-b288-bb1138f4096d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36964c4644584d4282b04596ad20717c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:44:15.992162 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ae508-b69a-4558-b288-bb1138f4096d service nova] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:44:15.992448 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ae508-b69a-4558-b288-bb1138f4096d service nova] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:44:15.992727 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ae508-b69a-4558-b288-bb1138f4096d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:44:16.001325 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0ae508-b69a-4558-b288-bb1138f4096d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:44:16.002933 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0ae508-b69a-4558-b288-bb1138f4096d service nova] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:44:16.011615 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 616/1234] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:44:15 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:44:19.576844 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=3 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:44:26.007664 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=10 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:44:39.673372 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38053f26-4b47-4758-a7d5-ac6554d35c58 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:44:39.684873 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38053f26-4b47-4758-a7d5-ac6554d35c58 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:44:39.690442 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fda76e-7f3c-4df4-9e39-b1dfd196c6ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36964c4644584d4282b04596ad20717c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:44:39.691066 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fda76e-7f3c-4df4-9e39-b1dfd196c6ec service nova] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:44:39.691346 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fda76e-7f3c-4df4-9e39-b1dfd196c6ec service nova] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:44:39.691998 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fda76e-7f3c-4df4-9e39-b1dfd196c6ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:44:39.699403 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fda76e-7f3c-4df4-9e39-b1dfd196c6ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:44:39.700977 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fda76e-7f3c-4df4-9e39-b1dfd196c6ec service nova] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:44:39.710202 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 619/1235] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:44:39 2022] GET /identity/v3/auth/tokens => generated 2810 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:44:39.862879 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ae508-b69a-4558-b288-bb1138f4096d service nova] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:44:39.866051 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fda76e-7f3c-4df4-9e39-b1dfd196c6ec service nova] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:44:39.872335 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ae508-b69a-4558-b288-bb1138f4096d service nova] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:44:39.875845 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fda76e-7f3c-4df4-9e39-b1dfd196c6ec service nova] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:44:39.876446 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420118e-b519-462a-90e6-416dab305c97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645587202a91426c98f86abdcddce8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:44:39.877055 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420118e-b519-462a-90e6-416dab305c97 service neutron] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:44:39.877338 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420118e-b519-462a-90e6-416dab305c97 service neutron] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:44:39.877656 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420118e-b519-462a-90e6-416dab305c97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:44:39.879615 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b426948-5fdd-4409-82ef-a1fcc78f3c51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645587202a91426c98f86abdcddce8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:44:39.880221 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b426948-5fdd-4409-82ef-a1fcc78f3c51 service neutron] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:44:39.880531 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b426948-5fdd-4409-82ef-a1fcc78f3c51 service neutron] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:44:39.880807 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b426948-5fdd-4409-82ef-a1fcc78f3c51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:44:39.887336 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c420118e-b519-462a-90e6-416dab305c97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:44:39.887973 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b426948-5fdd-4409-82ef-a1fcc78f3c51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:44:39.888748 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c420118e-b519-462a-90e6-416dab305c97 service neutron] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:44:39.889379 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b426948-5fdd-4409-82ef-a1fcc78f3c51 service neutron] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:44:39.897226 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 620/1236] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:44:39 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:44:39.899177 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 617/1237] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:44:39 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:44:41.200205 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b426948-5fdd-4409-82ef-a1fcc78f3c51 service neutron] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:44:41.209440 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b426948-5fdd-4409-82ef-a1fcc78f3c51 service neutron] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:44:41.213452 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0359870-0ca0-439e-990a-f7d65e48a4e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645587202a91426c98f86abdcddce8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:44:41.214100 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0359870-0ca0-439e-990a-f7d65e48a4e1 service neutron] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:44:41.214397 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0359870-0ca0-439e-990a-f7d65e48a4e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:44:41.214717 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0359870-0ca0-439e-990a-f7d65e48a4e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:44:41.225206 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0359870-0ca0-439e-990a-f7d65e48a4e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:44:41.226698 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0359870-0ca0-439e-990a-f7d65e48a4e1 service neutron] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:44:41.238164 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 621/1238] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:44:41 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:44:49.895055 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=6 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:44:51.232549 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=18 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:45:24.971598 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420118e-b519-462a-90e6-416dab305c97 service neutron] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:45:24.987854 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420118e-b519-462a-90e6-416dab305c97 service neutron] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:45:24.994138 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2cdea-9801-4695-a10e-081185de0296 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36964c4644584d4282b04596ad20717c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:45:24.994899 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2cdea-9801-4695-a10e-081185de0296 service nova] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:45:24.995089 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2cdea-9801-4695-a10e-081185de0296 service nova] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:45:24.995371 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2cdea-9801-4695-a10e-081185de0296 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:45:25.005310 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2cdea-9801-4695-a10e-081185de0296 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:45:25.014194 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2cdea-9801-4695-a10e-081185de0296 service nova] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:45:25.047647 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 618/1239] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:45:24 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:45:26.262616 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0359870-0ca0-439e-990a-f7d65e48a4e1 service neutron] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:45:26.274923 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0359870-0ca0-439e-990a-f7d65e48a4e1 service neutron] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:45:26.279932 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74484dcc-0fc2-4e08-8adc-944dc23a8d22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36964c4644584d4282b04596ad20717c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:45:26.280556 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74484dcc-0fc2-4e08-8adc-944dc23a8d22 service nova] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:45:26.280843 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74484dcc-0fc2-4e08-8adc-944dc23a8d22 service nova] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:45:26.281122 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74484dcc-0fc2-4e08-8adc-944dc23a8d22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:45:26.292952 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74484dcc-0fc2-4e08-8adc-944dc23a8d22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:45:26.293150 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74484dcc-0fc2-4e08-8adc-944dc23a8d22 service nova] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:45:26.309256 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 622/1240] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:45:26 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 12:45:32.917638 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2cdea-9801-4695-a10e-081185de0296 service nova] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:45:32.926702 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2cdea-9801-4695-a10e-081185de0296 service nova] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:45:32.930898 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a7883-e4e9-44c9-9509-e23aea7bbbf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645587202a91426c98f86abdcddce8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:45:32.931527 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a7883-e4e9-44c9-9509-e23aea7bbbf7 service neutron] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:45:32.931807 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a7883-e4e9-44c9-9509-e23aea7bbbf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:45:32.932083 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a7883-e4e9-44c9-9509-e23aea7bbbf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:45:32.996273 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a7883-e4e9-44c9-9509-e23aea7bbbf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:45:32.998409 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a7883-e4e9-44c9-9509-e23aea7bbbf7 service neutron] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:45:33.020781 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 619/1241] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:45:32 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:45:36.205958 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51797b-23c0-4314-9908-bb23efc24b30 None None] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:45:36.206813 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51797b-23c0-4314-9908-bb23efc24b30 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:45:36.207270 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51797b-23c0-4314-9908-bb23efc24b30 None None] PATH_INFO: `/` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:45:36.208900 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 623/1242] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jul 27 12:45:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:45:36.217932 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9a5fc-b8c3-467a-9e3b-a0ce72d99a18 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:45:36.218705 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9a5fc-b8c3-467a-9e3b-a0ce72d99a18 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:45:36.219004 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9a5fc-b8c3-467a-9e3b-a0ce72d99a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:45:36.292081 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-f9a9a5fc-b8c3-467a-9e3b-a0ce72d99a18 None None] MFA Rules not processed for user `6cc3f626dcb5495c9eed35a8e50092e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:45:36.293370 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-f9a9a5fc-b8c3-467a-9e3b-a0ce72d99a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:45:36.303211 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=6 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:45:36.303419 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 620/1243] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jul 27 12:45:36 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:45:36.314185 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51797b-23c0-4314-9908-bb23efc24b30 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:45:36.327993 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51797b-23c0-4314-9908-bb23efc24b30 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:45:36.333718 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c24a7-740c-4b85-9c1a-cb9a5364763c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc3f626dcb5495c9eed35a8e50092e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:45:36.335174 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c24a7-740c-4b85-9c1a-cb9a5364763c service placement] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:45:36.335468 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c24a7-740c-4b85-9c1a-cb9a5364763c service placement] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:45:36.335730 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c24a7-740c-4b85-9c1a-cb9a5364763c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:45:36.347127 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346c24a7-740c-4b85-9c1a-cb9a5364763c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:45:36.348732 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346c24a7-740c-4b85-9c1a-cb9a5364763c service placement] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:45:36.359666 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 624/1244] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:45:36 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 12:45:39.672929 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4bc36-27ef-4eeb-bb67-4f2b5f767732 None None] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:45:39.673429 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4bc36-27ef-4eeb-bb67-4f2b5f767732 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:45:39.673635 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4bc36-27ef-4eeb-bb67-4f2b5f767732 None None] PATH_INFO: `/` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:45:39.675064 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 621/1245] 10.222.0.55 () {54 vars in 921 bytes} [Wed Jul 27 12:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 12:45:39.701167 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058f893-cd81-40ac-a6d4-c4b4f81ae907 None None] REQUEST_METHOD: `POST` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:45:39.701640 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058f893-cd81-40ac-a6d4-c4b4f81ae907 None None] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:45:39.701802 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058f893-cd81-40ac-a6d4-c4b4f81ae907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:45:39.722825 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.auth.core [None req-8058f893-cd81-40ac-a6d4-c4b4f81ae907 None None] MFA Rules not processed for user `6cc3f626dcb5495c9eed35a8e50092e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87917) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:45:39.725524 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-8058f893-cd81-40ac-a6d4-c4b4f81ae907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:45:39.736643 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4bc36-27ef-4eeb-bb67-4f2b5f767732 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:45:39.742783 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 625/1246] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Jul 27 12:45:39 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:45:39.754743 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4bc36-27ef-4eeb-bb67-4f2b5f767732 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:45:39.755699 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058f893-cd81-40ac-a6d4-c4b4f81ae907 None None] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:45:39.760180 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f242e06-e117-4837-aca2-055f9822edc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:45:39.761047 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f242e06-e117-4837-aca2-055f9822edc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:45:39.761338 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f242e06-e117-4837-aca2-055f9822edc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:45:39.761659 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f242e06-e117-4837-aca2-055f9822edc6 admin admin] PATH_INFO: `/v3/users/d36bba6dfcd94049a894e7f11ce92c6e` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:45:39.762861 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f242e06-e117-4837-aca2-055f9822edc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d36bba6dfcd94049a894e7f11ce92c6e)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:45:39.763876 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: WARNING py.warnings [None req-6f242e06-e117-4837-aca2-055f9822edc6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 12:45:39.763876 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: warnings.warn(msg) Jul 27 12:45:39.763876 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: Jul 27 12:45:39.765079 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f242e06-e117-4837-aca2-055f9822edc6 admin admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:45:39.766733 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058f893-cd81-40ac-a6d4-c4b4f81ae907 None None] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:45:39.771724 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a220464-cb8f-4688-a35d-d1dec709e539 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc3f626dcb5495c9eed35a8e50092e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:45:39.772959 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a220464-cb8f-4688-a35d-d1dec709e539 service placement] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:45:39.773245 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a220464-cb8f-4688-a35d-d1dec709e539 service placement] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:45:39.773517 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a220464-cb8f-4688-a35d-d1dec709e539 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:45:39.782321 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a220464-cb8f-4688-a35d-d1dec709e539 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:45:39.783906 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a220464-cb8f-4688-a35d-d1dec709e539 service placement] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:45:39.793929 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 626/1247] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:45:39 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 12:45:39.829758 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [None req-6f242e06-e117-4837-aca2-055f9822edc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd36bba6dfcd94049a894e7f11ce92c6e'} {{(pid=87918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:45:39.838555 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [None req-6f242e06-e117-4837-aca2-055f9822edc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd36bba6dfcd94049a894e7f11ce92c6e'} {{(pid=87918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:45:39.857931 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [None req-6f242e06-e117-4837-aca2-055f9822edc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd36bba6dfcd94049a894e7f11ce92c6e'} {{(pid=87918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:45:39.858675 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [None req-6f242e06-e117-4837-aca2-055f9822edc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd36bba6dfcd94049a894e7f11ce92c6e'} {{(pid=87918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:45:39.859307 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [None req-6f242e06-e117-4837-aca2-055f9822edc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd36bba6dfcd94049a894e7f11ce92c6e'} {{(pid=87918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:45:39.875214 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 622/1248] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Jul 27 12:45:39 2022] DELETE /identity/v3/users/d36bba6dfcd94049a894e7f11ce92c6e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 12:45:40.057070 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a220464-cb8f-4688-a35d-d1dec709e539 service placement] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:45:40.067397 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a220464-cb8f-4688-a35d-d1dec709e539 service placement] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:45:40.123935 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8083a-7cf1-4fa9-951c-e5f1af96cd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:45:40.124671 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8083a-7cf1-4fa9-951c-e5f1af96cd22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:45:40.124935 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8083a-7cf1-4fa9-951c-e5f1af96cd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:45:40.125208 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8083a-7cf1-4fa9-951c-e5f1af96cd22 admin admin] PATH_INFO: `/v3/projects/9ea9ff9bd98e4563a6e32821f080ab4f` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:45:40.126381 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce8083a-7cf1-4fa9-951c-e5f1af96cd22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ea9ff9bd98e4563a6e32821f080ab4f)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:45:40.127405 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: WARNING py.warnings [None req-cce8083a-7cf1-4fa9-951c-e5f1af96cd22 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 12:45:40.127405 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: warnings.warn(msg) Jul 27 12:45:40.127405 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: Jul 27 12:45:40.128588 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce8083a-7cf1-4fa9-951c-e5f1af96cd22 admin admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:45:40.182486 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [None req-cce8083a-7cf1-4fa9-951c-e5f1af96cd22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ea9ff9bd98e4563a6e32821f080ab4f', 'request_id': 'req-cce8083a-7cf1-4fa9-951c-e5f1af96cd22'} {{(pid=87917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:45:40.190273 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [None req-cce8083a-7cf1-4fa9-951c-e5f1af96cd22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ea9ff9bd98e4563a6e32821f080ab4f', 'request_id': 'req-cce8083a-7cf1-4fa9-951c-e5f1af96cd22'} {{(pid=87917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:45:40.204027 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [None req-cce8083a-7cf1-4fa9-951c-e5f1af96cd22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ea9ff9bd98e4563a6e32821f080ab4f', 'request_id': 'req-cce8083a-7cf1-4fa9-951c-e5f1af96cd22'} {{(pid=87917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:45:40.214897 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [None req-cce8083a-7cf1-4fa9-951c-e5f1af96cd22 admin admin] The token cache is being invalidate because project 9ea9ff9bd98e4563a6e32821f080ab4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 12:45:40.215187 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [None req-cce8083a-7cf1-4fa9-951c-e5f1af96cd22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:45:40.215951 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [None req-cce8083a-7cf1-4fa9-951c-e5f1af96cd22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:45:40.217484 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 627/1249] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Jul 27 12:45:40 2022] DELETE /identity/v3/projects/9ea9ff9bd98e4563a6e32821f080ab4f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 12:45:40.221447 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f242e06-e117-4837-aca2-055f9822edc6 admin admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:45:40.222920 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-6f242e06-e117-4837-aca2-055f9822edc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:45:40.232231 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:45:40.236024 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f242e06-e117-4837-aca2-055f9822edc6 admin admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:45:40.293546 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192b6cb-cc97-4762-8739-d3e038ca4456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:45:40.294205 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192b6cb-cc97-4762-8739-d3e038ca4456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:45:40.294531 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192b6cb-cc97-4762-8739-d3e038ca4456 admin admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:45:40.294808 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192b6cb-cc97-4762-8739-d3e038ca4456 admin admin] PATH_INFO: `/v3/users/4b988807d44248479fc06c13e4ad2198` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:45:40.295963 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1192b6cb-cc97-4762-8739-d3e038ca4456 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b988807d44248479fc06c13e4ad2198)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:45:40.297914 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1192b6cb-cc97-4762-8739-d3e038ca4456 admin admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:45:40.342764 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [None req-1192b6cb-cc97-4762-8739-d3e038ca4456 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b988807d44248479fc06c13e4ad2198'} {{(pid=87918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:45:40.350685 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [None req-1192b6cb-cc97-4762-8739-d3e038ca4456 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b988807d44248479fc06c13e4ad2198'} {{(pid=87918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:45:40.363684 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [None req-1192b6cb-cc97-4762-8739-d3e038ca4456 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b988807d44248479fc06c13e4ad2198'} {{(pid=87918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:45:40.364330 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [None req-1192b6cb-cc97-4762-8739-d3e038ca4456 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b988807d44248479fc06c13e4ad2198'} {{(pid=87918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:45:40.364937 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [None req-1192b6cb-cc97-4762-8739-d3e038ca4456 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b988807d44248479fc06c13e4ad2198'} {{(pid=87918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:45:40.377360 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 623/1250] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Jul 27 12:45:40 2022] DELETE /identity/v3/users/4b988807d44248479fc06c13e4ad2198 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 12:45:40.547741 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8083a-7cf1-4fa9-951c-e5f1af96cd22 admin admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:45:40.549184 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-cce8083a-7cf1-4fa9-951c-e5f1af96cd22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:45:40.563861 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8083a-7cf1-4fa9-951c-e5f1af96cd22 admin admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:45:40.616941 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:45:40.623872 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44c7a2-bd99-4a98-b49d-af67e8a085e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:45:40.624865 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44c7a2-bd99-4a98-b49d-af67e8a085e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:45:40.625151 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44c7a2-bd99-4a98-b49d-af67e8a085e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:45:40.625489 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44c7a2-bd99-4a98-b49d-af67e8a085e5 admin admin] PATH_INFO: `/v3/projects/e9aab62d16754c2482194a3bf0321e3c` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:45:40.627026 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c44c7a2-bd99-4a98-b49d-af67e8a085e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9aab62d16754c2482194a3bf0321e3c)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:45:40.629105 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c44c7a2-bd99-4a98-b49d-af67e8a085e5 admin admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:45:40.803023 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [None req-6c44c7a2-bd99-4a98-b49d-af67e8a085e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9aab62d16754c2482194a3bf0321e3c', 'request_id': 'req-6c44c7a2-bd99-4a98-b49d-af67e8a085e5'} {{(pid=87917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:45:40.810863 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [None req-6c44c7a2-bd99-4a98-b49d-af67e8a085e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9aab62d16754c2482194a3bf0321e3c', 'request_id': 'req-6c44c7a2-bd99-4a98-b49d-af67e8a085e5'} {{(pid=87917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:45:40.818522 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [None req-6c44c7a2-bd99-4a98-b49d-af67e8a085e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9aab62d16754c2482194a3bf0321e3c', 'request_id': 'req-6c44c7a2-bd99-4a98-b49d-af67e8a085e5'} {{(pid=87917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:45:40.829723 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [None req-6c44c7a2-bd99-4a98-b49d-af67e8a085e5 admin admin] The token cache is being invalidate because project e9aab62d16754c2482194a3bf0321e3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 12:45:40.830016 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [None req-6c44c7a2-bd99-4a98-b49d-af67e8a085e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:45:40.830656 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [None req-6c44c7a2-bd99-4a98-b49d-af67e8a085e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:45:40.832185 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 628/1251] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Jul 27 12:45:40 2022] DELETE /identity/v3/projects/e9aab62d16754c2482194a3bf0321e3c => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 12:45:50.373995 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=51,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:45:50.826754 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=25,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:46:14.832439 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66456a8-ba88-4798-aa38-e3ff448927a7 None None] REQUEST_METHOD: `POST` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:46:14.832913 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66456a8-ba88-4798-aa38-e3ff448927a7 None None] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:46:14.833020 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66456a8-ba88-4798-aa38-e3ff448927a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:46:14.853732 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.auth.core [None req-c66456a8-ba88-4798-aa38-e3ff448927a7 None None] MFA Rules not processed for user `5cfc6a65c2c64ef0bf5c071cbbddd20e`. Rule list: `[]` (Enabled: `True`). {{(pid=87918) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 12:46:14.854943 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-c66456a8-ba88-4798-aa38-e3ff448927a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:46:14.907974 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 624/1252] 10.222.0.55 () {58 vars in 958 bytes} [Wed Jul 27 12:46:14 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 12:46:15.223193 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44c7a2-bd99-4a98-b49d-af67e8a085e5 admin admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:46:15.224712 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-6c44c7a2-bd99-4a98-b49d-af67e8a085e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:46:15.280316 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44c7a2-bd99-4a98-b49d-af67e8a085e5 admin admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:46:15.283874 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91463417-e15c-4465-a563-0f3fd680c6f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645587202a91426c98f86abdcddce8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:46:15.284484 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91463417-e15c-4465-a563-0f3fd680c6f8 service neutron] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:46:15.284766 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91463417-e15c-4465-a563-0f3fd680c6f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:46:15.285041 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91463417-e15c-4465-a563-0f3fd680c6f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:46:15.286758 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-91463417-e15c-4465-a563-0f3fd680c6f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:46:15.295790 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91463417-e15c-4465-a563-0f3fd680c6f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:46:15.297207 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91463417-e15c-4465-a563-0f3fd680c6f8 service neutron] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:46:15.305324 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 629/1253] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:46:15 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 12:46:15.735841 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66456a8-ba88-4798-aa38-e3ff448927a7 None None] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:46:15.737254 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-c66456a8-ba88-4798-aa38-e3ff448927a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:46:15.810579 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66456a8-ba88-4798-aa38-e3ff448927a7 None None] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:46:15.815480 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0cd2c3-fdf6-4cce-aa1c-62a57d37e046 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc3f626dcb5495c9eed35a8e50092e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:46:15.816097 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cd2c3-fdf6-4cce-aa1c-62a57d37e046 service placement] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:46:15.816376 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cd2c3-fdf6-4cce-aa1c-62a57d37e046 service placement] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:46:15.816649 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cd2c3-fdf6-4cce-aa1c-62a57d37e046 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:46:15.818432 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-3d0cd2c3-fdf6-4cce-aa1c-62a57d37e046 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:46:15.829351 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0cd2c3-fdf6-4cce-aa1c-62a57d37e046 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:46:15.830951 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0cd2c3-fdf6-4cce-aa1c-62a57d37e046 service placement] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:46:15.840940 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 625/1254] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:46:15 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:46:24.719896 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91463417-e15c-4465-a563-0f3fd680c6f8 service neutron] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:46:24.721375 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-91463417-e15c-4465-a563-0f3fd680c6f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:46:24.793546 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91463417-e15c-4465-a563-0f3fd680c6f8 service neutron] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:46:24.798615 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02b560-d284-4ed6-ad58-92f0baca6f1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36964c4644584d4282b04596ad20717c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:46:24.799246 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02b560-d284-4ed6-ad58-92f0baca6f1d service nova] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:46:24.799526 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02b560-d284-4ed6-ad58-92f0baca6f1d service nova] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:46:24.799797 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02b560-d284-4ed6-ad58-92f0baca6f1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:46:24.801519 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-1d02b560-d284-4ed6-ad58-92f0baca6f1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:46:24.812502 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02b560-d284-4ed6-ad58-92f0baca6f1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:46:24.814046 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02b560-d284-4ed6-ad58-92f0baca6f1d service nova] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:46:24.823432 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 630/1255] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:46:24 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:46:25.836976 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=57 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:46:34.819459 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=58 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:48:30.054147 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0cd2c3-fdf6-4cce-aa1c-62a57d37e046 service placement] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:48:30.055536 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-3d0cd2c3-fdf6-4cce-aa1c-62a57d37e046 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:48:30.114540 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0cd2c3-fdf6-4cce-aa1c-62a57d37e046 service placement] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:48:30.120092 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ad797-778b-4c99-87da-fe19266a7f20 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cc3f626dcb5495c9eed35a8e50092e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:48:30.120687 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ad797-778b-4c99-87da-fe19266a7f20 service placement] REQUEST_METHOD: `GET` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:48:30.120968 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ad797-778b-4c99-87da-fe19266a7f20 service placement] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:48:30.121242 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ad797-778b-4c99-87da-fe19266a7f20 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:48:30.122936 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-4e8ad797-778b-4c99-87da-fe19266a7f20 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:48:30.133920 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ad797-778b-4c99-87da-fe19266a7f20 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:48:30.135467 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ad797-778b-4c99-87da-fe19266a7f20 service placement] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:48:30.144727 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 626/1256] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:48:30 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:48:40.140888 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=28 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:48:51.100333 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02b560-d284-4ed6-ad58-92f0baca6f1d service nova] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:48:51.101773 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-1d02b560-d284-4ed6-ad58-92f0baca6f1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:48:51.142957 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02b560-d284-4ed6-ad58-92f0baca6f1d service nova] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:48:51.146475 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9cf3bf-1564-4269-892b-b39fc7e1ca31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '645587202a91426c98f86abdcddce8cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3316e9a169444ac827619608acc9fb7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:48:51.147088 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9cf3bf-1564-4269-892b-b39fc7e1ca31 service neutron] REQUEST_METHOD: `GET` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:48:51.147372 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9cf3bf-1564-4269-892b-b39fc7e1ca31 service neutron] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:48:51.147648 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9cf3bf-1564-4269-892b-b39fc7e1ca31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:48:51.149384 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-aa9cf3bf-1564-4269-892b-b39fc7e1ca31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:48:51.232702 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9cf3bf-1564-4269-892b-b39fc7e1ca31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:48:51.234218 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9cf3bf-1564-4269-892b-b39fc7e1ca31 service neutron] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:48:51.243706 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 631/1257] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Jul 27 12:48:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 12:48:57.720053 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ad797-778b-4c99-87da-fe19266a7f20 service placement] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:48:57.722214 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-4e8ad797-778b-4c99-87da-fe19266a7f20 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:48:57.736705 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ad797-778b-4c99-87da-fe19266a7f20 service placement] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:48:57.741395 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818f8da-3e5a-4eca-8bfb-41baad4a8764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:48:57.742078 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818f8da-3e5a-4eca-8bfb-41baad4a8764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:48:57.742557 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818f8da-3e5a-4eca-8bfb-41baad4a8764 admin admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:48:57.742846 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818f8da-3e5a-4eca-8bfb-41baad4a8764 admin admin] PATH_INFO: `/v3/users/5cfc6a65c2c64ef0bf5c071cbbddd20e` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:48:57.744771 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0818f8da-3e5a-4eca-8bfb-41baad4a8764 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cfc6a65c2c64ef0bf5c071cbbddd20e)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:48:57.746717 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0818f8da-3e5a-4eca-8bfb-41baad4a8764 admin admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:48:57.795816 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [None req-0818f8da-3e5a-4eca-8bfb-41baad4a8764 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cfc6a65c2c64ef0bf5c071cbbddd20e'} {{(pid=87918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:48:57.802713 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [None req-0818f8da-3e5a-4eca-8bfb-41baad4a8764 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cfc6a65c2c64ef0bf5c071cbbddd20e'} {{(pid=87918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:48:57.815670 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [None req-0818f8da-3e5a-4eca-8bfb-41baad4a8764 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cfc6a65c2c64ef0bf5c071cbbddd20e'} {{(pid=87918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:48:57.816379 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [None req-0818f8da-3e5a-4eca-8bfb-41baad4a8764 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cfc6a65c2c64ef0bf5c071cbbddd20e'} {{(pid=87918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:48:57.816975 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [None req-0818f8da-3e5a-4eca-8bfb-41baad4a8764 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cfc6a65c2c64ef0bf5c071cbbddd20e'} {{(pid=87918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:48:57.830405 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 627/1258] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Jul 27 12:48:57 2022] DELETE /identity/v3/users/5cfc6a65c2c64ef0bf5c071cbbddd20e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 12:48:58.004357 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9cf3bf-1564-4269-892b-b39fc7e1ca31 service neutron] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:48:58.016055 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9cf3bf-1564-4269-892b-b39fc7e1ca31 service neutron] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:48:58.072209 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b2355-e619-48f6-8c73-8f709a958d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:48:58.072849 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b2355-e619-48f6-8c73-8f709a958d8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:48:58.073131 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b2355-e619-48f6-8c73-8f709a958d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:48:58.073406 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b2355-e619-48f6-8c73-8f709a958d8c admin admin] PATH_INFO: `/v3/projects/719d22382d1141e6a2daee3d33467c66` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:48:58.074594 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b2355-e619-48f6-8c73-8f709a958d8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=719d22382d1141e6a2daee3d33467c66)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:48:58.076489 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b2355-e619-48f6-8c73-8f709a958d8c admin admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:48:58.120039 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:48:58.121233 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [None req-160b2355-e619-48f6-8c73-8f709a958d8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '719d22382d1141e6a2daee3d33467c66', 'request_id': 'req-160b2355-e619-48f6-8c73-8f709a958d8c'} {{(pid=87917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:48:58.130350 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [None req-160b2355-e619-48f6-8c73-8f709a958d8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '719d22382d1141e6a2daee3d33467c66', 'request_id': 'req-160b2355-e619-48f6-8c73-8f709a958d8c'} {{(pid=87917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:48:58.136587 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [None req-160b2355-e619-48f6-8c73-8f709a958d8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '719d22382d1141e6a2daee3d33467c66', 'request_id': 'req-160b2355-e619-48f6-8c73-8f709a958d8c'} {{(pid=87917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:48:58.146620 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [None req-160b2355-e619-48f6-8c73-8f709a958d8c admin admin] The token cache is being invalidate because project 719d22382d1141e6a2daee3d33467c66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 12:48:58.146908 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [None req-160b2355-e619-48f6-8c73-8f709a958d8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:48:58.147533 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [None req-160b2355-e619-48f6-8c73-8f709a958d8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:48:58.149061 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 632/1259] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Jul 27 12:48:58 2022] DELETE /identity/v3/projects/719d22382d1141e6a2daee3d33467c66 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 12:48:58.153203 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818f8da-3e5a-4eca-8bfb-41baad4a8764 admin admin] Authenticating user token {{(pid=87918) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:48:58.154626 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.fernet_utils [None req-0818f8da-3e5a-4eca-8bfb-41baad4a8764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87918) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:48:58.167749 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818f8da-3e5a-4eca-8bfb-41baad4a8764 admin admin] Validating token access rules against request {{(pid=87918) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:48:58.223158 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4ac68-c300-4ec1-b4df-46c97934a8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87918) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:48:58.223719 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4ac68-c300-4ec1-b4df-46c97934a8be admin admin] REQUEST_METHOD: `DELETE` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:48:58.223999 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4ac68-c300-4ec1-b4df-46c97934a8be admin admin] SCRIPT_NAME: `/identity` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:48:58.224272 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4ac68-c300-4ec1-b4df-46c97934a8be admin admin] PATH_INFO: `/v3/users/3532bf2ac8bb452faa5350a47d40143a` {{(pid=87918) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:48:58.225494 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4ac68-c300-4ec1-b4df-46c97934a8be admin admin] RBAC: Authorizing `identity:delete_user(user_id=3532bf2ac8bb452faa5350a47d40143a)` {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:48:58.227510 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4ac68-c300-4ec1-b4df-46c97934a8be admin admin] RBAC: Authorization granted {{(pid=87918) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:48:58.272240 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [None req-6ec4ac68-c300-4ec1-b4df-46c97934a8be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3532bf2ac8bb452faa5350a47d40143a'} {{(pid=87918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:48:58.279282 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [None req-6ec4ac68-c300-4ec1-b4df-46c97934a8be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3532bf2ac8bb452faa5350a47d40143a'} {{(pid=87918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:48:58.291669 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [None req-6ec4ac68-c300-4ec1-b4df-46c97934a8be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3532bf2ac8bb452faa5350a47d40143a'} {{(pid=87918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:48:58.292297 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [None req-6ec4ac68-c300-4ec1-b4df-46c97934a8be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3532bf2ac8bb452faa5350a47d40143a'} {{(pid=87918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:48:58.292896 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG keystone.notifications [None req-6ec4ac68-c300-4ec1-b4df-46c97934a8be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3532bf2ac8bb452faa5350a47d40143a'} {{(pid=87918) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:48:58.294896 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:48:58.307538 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: [pid: 87918|app: 0|req: 628/1260] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Jul 27 12:48:58 2022] DELETE /identity/v3/users/3532bf2ac8bb452faa5350a47d40143a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 12:48:58.491612 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b2355-e619-48f6-8c73-8f709a958d8c admin admin] Authenticating user token {{(pid=87917) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 12:48:58.493079 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.fernet_utils [None req-160b2355-e619-48f6-8c73-8f709a958d8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87917) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 12:48:58.507578 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b2355-e619-48f6-8c73-8f709a958d8c admin admin] Validating token access rules against request {{(pid=87917) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 12:48:58.569618 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b41174-6896-428a-ba3a-1687f34985aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39c655ecdea3454d98a7abe23dc966e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '618eab11857d49309c9a7cb9985a7981', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87917) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 12:48:58.570295 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b41174-6896-428a-ba3a-1687f34985aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 12:48:58.570576 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b41174-6896-428a-ba3a-1687f34985aa admin admin] SCRIPT_NAME: `/identity` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 12:48:58.570851 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b41174-6896-428a-ba3a-1687f34985aa admin admin] PATH_INFO: `/v3/projects/0b73b37a64f2417cbdc167091e509513` {{(pid=87917) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 12:48:58.572015 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b41174-6896-428a-ba3a-1687f34985aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b73b37a64f2417cbdc167091e509513)` {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 12:48:58.573962 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b41174-6896-428a-ba3a-1687f34985aa admin admin] RBAC: Authorization granted {{(pid=87917) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 12:48:58.619352 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [None req-b9b41174-6896-428a-ba3a-1687f34985aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b73b37a64f2417cbdc167091e509513', 'request_id': 'req-b9b41174-6896-428a-ba3a-1687f34985aa'} {{(pid=87917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:48:58.626513 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [None req-b9b41174-6896-428a-ba3a-1687f34985aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b73b37a64f2417cbdc167091e509513', 'request_id': 'req-b9b41174-6896-428a-ba3a-1687f34985aa'} {{(pid=87917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:48:58.632689 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [None req-b9b41174-6896-428a-ba3a-1687f34985aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b73b37a64f2417cbdc167091e509513', 'request_id': 'req-b9b41174-6896-428a-ba3a-1687f34985aa'} {{(pid=87917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:48:58.643023 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [None req-b9b41174-6896-428a-ba3a-1687f34985aa admin admin] The token cache is being invalidate because project 0b73b37a64f2417cbdc167091e509513 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87917) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 12:48:58.643317 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [None req-b9b41174-6896-428a-ba3a-1687f34985aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:48:58.643996 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG keystone.notifications [None req-b9b41174-6896-428a-ba3a-1687f34985aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87917) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 12:48:58.645583 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: [pid: 87917|app: 0|req: 633/1261] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Jul 27 12:48:58 2022] DELETE /identity/v3/projects/0b73b37a64f2417cbdc167091e509513 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 12:49:08.305952 dv-osbrick-836063-13-ceph devstack@keystone.service[87918]: DEBUG dbcounter [-] [87918] Writing DB stats keystone:SELECT=4 {{(pid=87918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 12:49:08.639857 dv-osbrick-836063-13-ceph devstack@keystone.service[87917]: DEBUG dbcounter [-] [87917] Writing DB stats keystone:SELECT=58,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87917) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}